Feb 16 18:12:56.652764 np0000155649 systemd[1]: Started devstack@neutron-ovn-maintenance-worker.service - Devstack devstack@neutron-ovn-maintenance-worker.service. Feb 16 18:12:58.082338 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.common.config [-] Logging enabled! Feb 16 18:12:58.082993 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.common.config [-] /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker version 28.0.0.0b3.dev139 Feb 16 18:12:58.082993 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.common.config [-] command line: /opt/stack/data/venv/bin/neutron-ovn-maintenance-worker --config-file /etc/neutron/neutron.conf --config-file /etc/neutron/plugins/ml2/ml2_conf.ini {{(pid=104742) setup_logging /opt/stack/neutron/neutron/common/config.py:124}} Feb 16 18:12:58.082993 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.server.ovn_maintenance [-] OVN maintenance process starting... Feb 16 18:12:58.082993 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "plugin-directory" by "neutron_lib.plugins.directory._create_plugin_directory" {{(pid=104742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Feb 16 18:12:58.083278 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" acquired by "neutron_lib.plugins.directory._create_plugin_directory" :: waited 0.000s {{(pid=104742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Feb 16 18:12:58.083278 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_concurrency.lockutils [-] Lock "plugin-directory" "released" by "neutron_lib.plugins.directory._create_plugin_directory" :: held 0.000s {{(pid=104742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Feb 16 18:12:58.083278 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "manager" by "neutron.manager.NeutronManager._create_instance" {{(pid=104742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Feb 16 18:12:58.083278 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_concurrency.lockutils [-] Lock "manager" acquired by "neutron.manager.NeutronManager._create_instance" :: waited 0.000s {{(pid=104742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Feb 16 18:12:58.083529 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [-] Loading core plugin: ml2 Feb 16 18:12:58.364790 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.364949 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.364949 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.365470 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.365573 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.365573 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.401033 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.401033 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.401283 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.407459 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.407572 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.407572 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.563039 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.563039 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.563412 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.563596 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.563683 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.563683 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.620446 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.620606 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.620606 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.620606 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: network precommit_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.620848 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: segment before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671077 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671196 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: agent before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671245 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671285 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671450 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671450 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671531 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment precommit_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671531 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671612 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671659 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671698 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > network precommit_delete 0, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671789 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port provisioning_complete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671844 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671890 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.671963 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672028 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672081 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete 0, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672189 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672244 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672313 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672383 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > agent after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672488 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672543 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672592 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.672944 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: network configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:58.672997 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: port configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:58.673046 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnet configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:58.673088 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: subnetpool configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:58.673153 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:58.673227 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [-] Tracking information for resource: security_group_rule configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:58.673440 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Configured type driver names: ['local', 'flat', 'vlan', 'geneve'] Feb 16 18:12:58.674077 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.type_flat [-] Allowable flat physical_network names: ['public'] Feb 16 18:12:58.674714 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.type_local [-] ML2 LocalTypeDriver initialization complete Feb 16 18:12:58.675236 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.type_vlan [-] Network VLAN ranges: OrderedDict({'public': [(1, 4094)]}) Feb 16 18:12:58.675410 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Loaded type driver names: ['flat', 'geneve', 'local', 'vlan'] Feb 16 18:12:58.675410 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Registered types: dict_keys(['flat', 'geneve', 'local', 'vlan']) Feb 16 18:12:58.675572 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Tenant network_types: ['geneve'] Feb 16 18:12:58.675658 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Configured extension driver names: ['port_security', 'qos'] Feb 16 18:12:58.676119 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Loaded extension driver names: ['port_security', 'qos'] Feb 16 18:12:58.676223 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Registered extension drivers: ['port_security', 'qos'] Feb 16 18:12:58.676302 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Configured mechanism driver names: ['ovn'] Feb 16 18:12:58.715315 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Loaded mechanism driver names: ['ovn'] Feb 16 18:12:58.715539 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Registered mechanism drivers: ['ovn'] Feb 16 18:12:58.715539 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] No mechanism drivers provide segment reachability information for agent scheduling. Feb 16 18:12:58.716165 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_response 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.716291 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port before_response 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:58.737367 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'flat' Feb 16 18:12:58.737367 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.type_flat [-] ML2 FlatTypeDriver initialization complete Feb 16 18:12:58.737367 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [-] Initializing driver for type 'geneve' Feb 16 18:12:58.737367 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.type_tunnel [-] geneve ID ranges: [(1, 65536)] Feb 16 18:12:58.745579 np0000155649 neutron-ovn-maintenance-worker[104742]: WARNING oslo_policy.policy [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 16 18:12:58.745858 np0000155649 neutron-ovn-maintenance-worker[104742]: WARNING oslo_policy.policy [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] JSON formatted policy_file support is deprecated since Victoria release. You need to use YAML format which will be default in future. You can use ``oslopolicy-convert-json-to-yaml`` tool to convert existing JSON-formatted policy file to YAML-formatted in backward compatible way: https://docs.openstack.org/oslo.policy/latest/cli/oslopolicy-convert-json-to-yaml.html. Feb 16 18:12:58.784625 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO dbcounter [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Registered counter for database neutron Feb 16 18:12:58.802328 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_db.sqlalchemy.engines [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=104742) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Feb 16 18:12:59.248655 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG dbcounter [-] [104742] Writer thread running {{(pid=104742) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Feb 16 18:12:59.438119 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Initializing driver for type 'local' Feb 16 18:12:59.438599 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Initializing driver for type 'vlan' Feb 16 18:12:59.552991 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.type_vlan [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] VlanTypeDriver initialization complete Feb 16 18:12:59.552991 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Initializing extension driver 'port_security' Feb 16 18:12:59.552991 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.extensions.port_security [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] PortSecurityExtensionDriver initialization complete Feb 16 18:12:59.552991 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Initializing extension driver 'qos' Feb 16 18:12:59.553574 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.plugins.ml2.extensions.qos [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QosExtensionDriver initialization complete {{(pid=104742) initialize /opt/stack/neutron/neutron/plugins/ml2/extensions/qos.py:31}} Feb 16 18:12:59.553574 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Initializing mechanism driver 'ovn' Feb 16 18:12:59.553574 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Starting OVNMechanismDriver Feb 16 18:12:59.554979 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > process before_spawn 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.554979 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > process after_init 55550000, True {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555379 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > segment after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555379 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > segment after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555379 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > segment after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555379 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > allowed_address_pair before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555594 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555594 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555685 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555727 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group precommit_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555798 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555893 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group_rule precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.555957 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group_rule after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556058 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group_rule before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556128 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > address_group after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556242 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > address_group after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > address_group after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556500 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > qos_plugin after_init 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556703 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > trunk_plugin after_init 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.556888 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > logging-plugin after_init 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.557301 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.services.logapi.drivers.ovn.driver [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVN logging driver registered Feb 16 18:12:59.558471 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.plugins.ml2.plugin [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] neutron.plugins.ml2.plugin.Ml2Plugin method _start_rpc_notifiers called with arguments () {} {{(pid=104742) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}} Feb 16 18:12:59.558670 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > port after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.558767 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > port after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.558846 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > port after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.558941 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > subnet after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559085 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > subnet after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559085 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > subnet after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559354 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > network after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559354 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > network after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559354 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > network after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559354 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559646 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559646 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559646 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group_rule after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559847 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group_rule after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559847 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > security_group_rule after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.559847 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > address_group after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.560067 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > address_group after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.560067 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > address_group after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.560067 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.plugins.ml2.ovo_rpc [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ML2 OVO RPC backend initialized. {{(pid=104742) __init__ /opt/stack/neutron/neutron/plugins/ml2/ovo_rpc.py:117}} Feb 16 18:12:59.560773 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.quota [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded quota_driver: . Feb 16 18:12:59.560876 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.plugin [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Modular L2 Plugin initialization complete Feb 16 18:12:59.560935 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading services supported by the core plugin {{(pid=104742) _load_services_from_core_plugin /opt/stack/neutron/neutron/manager.py:169}} Feb 16 18:12:59.561017 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.plugins.ml2.managers [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Got port-security extension from driver 'port_security' Feb 16 18:12:59.561294 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading service plugins: ['ovn-router', 'auto_allocate', 'tag', 'timestamp', 'network_ip_availability', 'flavors', 'revisions'] {{(pid=104742) _load_service_plugins /opt/stack/neutron/neutron/manager.py:194}} Feb 16 18:12:59.561390 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: ovn-router Feb 16 18:12:59.568762 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.568860 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: port after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.568938 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: port after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569013 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: subnet after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569101 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: subnetpool_address_scope after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569189 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: port before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569270 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: port after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569348 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > port precommit_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569427 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: port before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569506 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: port before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569586 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569676 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569733 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.569837 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: subnet after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.570406 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Tracking information for resource: router configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:59.570471 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.quota.resource_registry [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Tracking information for resource: floatingip configured {{(pid=104742) set_tracked_resource /opt/stack/neutron/neutron/quota/resource_registry.py:203}} Feb 16 18:12:59.570552 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.services.ovn_l3.plugin [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Starting OVNL3RouterPlugin Feb 16 18:12:59.570740 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > port_forwarding_plugin after_init 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.570913 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router before_create 55550100, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.570991 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_delete 55550100, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.571073 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_create 55550100, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.571241 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_update 55550100, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.573642 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.services.provider_configuration [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Service providers = [] {{(pid=104742) parse_service_provider_opt /opt/stack/neutron/neutron/services/provider_configuration.py:171}} Feb 16 18:12:59.573766 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.db.servicetype_db [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Adding provider configuration for service L3_ROUTER_NAT {{(pid=104742) add_provider_configuration /opt/stack/neutron/neutron/db/servicetype_db.py:42}} Feb 16 18:12:59.574722 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_create 55549900, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.574841 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router_interface after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.574905 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > floatingip after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.574965 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > floatingip precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575031 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > floatingip precommit_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575095 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > floatingip after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575188 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > floatingip after_status_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575261 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > floatingip after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575354 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > port_forwarding after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575427 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router_interface after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575511 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router after_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575584 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575663 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router after_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575730 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > router after_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.575824 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.services.service_base [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded 'neutron.services.ovn_l3.service_providers.ovn.OvnDriver' provider for service L3_ROUTER_NAT {{(pid=104742) load_drivers /opt/stack/neutron/neutron/services/service_base.py:49}} Feb 16 18:12:59.575938 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > process after_init 55550001, True {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.576010 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded L3_ROUTER_NAT plugin. Description: L3 Router Service Plugin for basic L3 forwarding using OVN {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.576084 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: auto_allocate Feb 16 18:12:59.576816 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: network precommit_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.576907 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: network precommit_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.577057 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded auto-allocated-topology plugin. Description: Auto Allocated Topology - aka get me a network. {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.577187 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: tag Feb 16 18:12:59.579461 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded TAG plugin. Description: Tag support {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.579461 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: timestamp Feb 16 18:12:59.580549 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded timestamp plugin. Description: Adds timestamps to Neutron resources with standard attributes {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.580672 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: network_ip_availability Feb 16 18:12:59.582295 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > rbac-policy before_create 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.582407 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > rbac-policy before_update 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.582407 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron_lib.callbacks.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Subscribe: > rbac-policy before_delete 55550000, False {{(pid=104742) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.582715 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded network-ip-availability plugin. Description: Provides IP availability data for each network and subnet. {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.582856 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: flavors Feb 16 18:12:59.583442 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded FLAVORS plugin. Description: Neutron Flavors and Service Profiles manager plugin {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.583561 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading Plugin: revisions Feb 16 18:12:59.584501 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.manager [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Successfully loaded revision_plugin plugin. Description: Adds revision numbers to resources. {{(pid=104742) _create_and_add_service_plugin /opt/stack/neutron/neutron/manager.py:229}} Feb 16 18:12:59.584501 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG oslo_concurrency.lockutils [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Lock "manager" "released" by "neutron.manager.NeutronManager._create_instance" :: held 1.501s {{(pid=104742) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Feb 16 18:12:59.584750 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] get_extension_paths = OrderedDict({'/opt/stack/neutron/neutron/extensions': 1}) {{(pid=104742) get_extensions_path /opt/stack/neutron/neutron/api/extensions.py:640}} Feb 16 18:12:59.584750 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Initializing extension manager. Feb 16 18:12:59.584937 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: __init__.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.585029 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: __pycache__ {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.585102 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: address_group.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.585365 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Address group" alias="address-group" description="Support address group" updated="2020-07-15T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.585558 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: address-group Feb 16 18:12:59.585639 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: address_scope.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.585869 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Address scope" alias="address-scope" description="Address scopes extension." updated="2015-07-26T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.586014 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: address-scope Feb 16 18:12:59.586083 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: admin_state_down_before_update.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.586298 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Enforce Router's Admin State Down Before Update Extension" alias="router-admin-state-down-before-update" description="Ensure that the admin state of a router is DOWN (admin_state_up=False) before updating the distributed attribute" updated="2019-07-02T15:56:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.586446 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension router-admin-state-down-before-update not supported by any of loaded plugins Feb 16 18:12:59.586526 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: agent.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.586743 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="agent" alias="agent" description="The agent management extension." updated="2013-02-03T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.586877 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: agent Feb 16 18:12:59.586951 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: agent_resources_synced.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.587127 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Agent's Resource View Synced to Placement" alias="agent-resources-synced" description="Stores success/failure of last sync to Placement" updated="2018-12-19T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.587292 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension agent-resources-synced not supported by any of loaded plugins Feb 16 18:12:59.587369 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: allowedaddresspairs.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.587889 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Allowed Address Pairs" alias="allowed-address-pairs" description="Provides allowed address pairs" updated="2013-07-23T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.588037 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: allowed-address-pairs Feb 16 18:12:59.588107 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: auto_allocated_topology.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.588360 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Auto Allocated Topology Services" alias="auto-allocated-topology" description="Auto Allocated Topology Services." updated="2016-01-01T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.588480 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: auto-allocated-topology Feb 16 18:12:59.588592 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: availability_zone.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.588803 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Availability Zone" alias="availability_zone" description="The availability zone extension." updated="2015-01-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.588908 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: availability_zone Feb 16 18:12:59.588992 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: availability_zone_filter.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.589207 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Availability Zone Filter Extension" alias="availability_zone_filter" description="Add filter parameters to AvailabilityZone resource" updated="2018-06-22T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.589327 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension availability_zone_filter not supported by any of loaded plugins Feb 16 18:12:59.589391 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: data_plane_status.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.589588 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port data plane status extension" alias="data-plane-status" description="Expose status of underlying data plane" updated="2017-01-24T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.589726 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension data-plane-status not supported by any of loaded plugins Feb 16 18:12:59.589819 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: default_subnetpools.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.589971 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Default Subnetpools" alias="default-subnetpools" description="Provides ability to mark and use a subnetpool as the default." updated="2016-02-18T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.590106 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: default-subnetpools Feb 16 18:12:59.590223 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: dhcpagentscheduler.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.590490 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="DHCP Agent Scheduler" alias="dhcp_agent_scheduler" description="Schedule networks among dhcp agents" updated="2013-02-07T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.590618 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: dhcp_agent_scheduler Feb 16 18:12:59.590702 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: dns.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.590867 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="DNS Integration" alias="dns-integration" description="Provides integration with DNS." updated="2015-08-15T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.591006 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: dns-integration Feb 16 18:12:59.591097 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: dns_domain_ports.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.591276 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="dns_domain for ports" alias="dns-domain-ports" description="Allows the DNS domain to be specified for a network port." updated="2017-04-24T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.591415 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: dns-domain-ports Feb 16 18:12:59.591502 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: dns_integration_domain_keywords.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.591665 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="DNS domain names with keywords allowed" alias="dns-integration-domain-keywords" description="Allows to use keywords like , , and as DNS domain name" updated="2020-06-15T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.591804 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: dns-integration-domain-keywords Feb 16 18:12:59.591881 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: dvr.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.592071 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Distributed Virtual Router" alias="dvr" description="Enables configuration of Distributed Virtual Routers." updated="2014-06-1T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.592253 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension dvr not supported by any of loaded plugins Feb 16 18:12:59.592353 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: ecmp_routes.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.592533 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Equal Cost Multipath Routing" alias="ecmp_routes" description="Allows traffic to reach thesame destination via multiple different links " updated="2020-11-26T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.592672 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension ecmp_routes not supported by any of loaded plugins Feb 16 18:12:59.592740 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: empty_string_filtering.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.592921 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Empty String Filtering Extension" alias="empty-string-filtering" description="Allow filtering by attributes with empty string value" updated="2018-05-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.593057 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: empty-string-filtering Feb 16 18:12:59.593165 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: expose_l3_conntrack_helper.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.593333 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Expose CT target rules for conntrack helper" alias="expose-l3-conntrack-helper" description="Expose allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.593478 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension expose-l3-conntrack-helper not supported by any of loaded plugins Feb 16 18:12:59.593547 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: expose_port_forwarding_in_fip.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.593755 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Expose Floating IP port forwardings" alias="expose-port-forwarding-in-fip" description="Expose port forwarding fields in floating IP response" updated="2018-06-28T16:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.593889 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension expose-port-forwarding-in-fip not supported by any of loaded plugins Feb 16 18:12:59.593967 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: external_net.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.594133 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron external network" alias="external-net" description="Adds external network attribute to network resource." updated="2013-01-14T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.594290 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: external-net Feb 16 18:12:59.594359 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: extra_dhcp_opt.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.594538 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Extra DHCP options" alias="extra_dhcp_opt" description="Extra options configuration for DHCP. For example PXE boot options to DHCP clients can be specified (e.g. tftp-server, server-ip-address, bootfile-name)" updated="2013-03-17T12:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.594672 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: extra_dhcp_opt Feb 16 18:12:59.594737 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: extraroute.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.594923 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Extra Route" alias="extraroute" description="Extra routes configuration for L3 router" updated="2013-02-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.595058 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: extraroute Feb 16 18:12:59.595133 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: extraroute_atomic.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.595335 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Atomically add/remove extra routes" alias="extraroute-atomic" description="Edit extra routes of a router on server side by atomically adding/removing extra routes" updated="2019-07-10T00:00:00+00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.595470 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: extraroute-atomic Feb 16 18:12:59.595536 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: filter_validation.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.595725 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Filter parameters validation" alias="filter-validation" description="Provides validation on filter parameters." updated="2018-07-04T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.595861 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: filter-validation Feb 16 18:12:59.595938 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: fip_pf_description.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.596109 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP Port Forwarding new attribute description" alias="floating-ip-port-forwarding-description" description="Add a description field to Port Forwarding rules" updated="2019-11-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.596294 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension floating-ip-port-forwarding-description not supported by any of loaded plugins Feb 16 18:12:59.596380 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: fip_pf_detail.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.596540 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP port forwarding detail" alias="floating-ip-port-forwarding-detail" description="Allow list floating ip return more port forwarding data, include'id' and 'internal_port_id'" updated="2022-05-06T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.596680 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: floating-ip-port-forwarding-detail Feb 16 18:12:59.596758 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: fip_pf_port_range.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.596919 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP Port Forwarding support port ranges" alias="floating-ip-port-forwarding-port-ranges" description="Add support to port ranges" updated="2020-07-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.597045 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension floating-ip-port-forwarding-port-ranges not supported by any of loaded plugins Feb 16 18:12:59.597116 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: fip_port_details.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.597311 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP Port Details Extension" alias="fip-port-details" description="Add port_details attribute to Floating IP resource" updated="2018-04-09T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.597445 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: fip-port-details Feb 16 18:12:59.597516 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: flavors.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.597712 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Service Flavors" alias="flavors" description="Flavor specification for Neutron advanced services." updated="2015-09-17T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.597845 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: flavors Feb 16 18:12:59.597916 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: floating_ip_port_forwarding.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.598281 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP Port Forwarding" alias="floating-ip-port-forwarding" description="Allow port forwarding from floating IP port to an internal port" updated="2018-01-19T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.598423 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension floating-ip-port-forwarding not supported by any of loaded plugins Feb 16 18:12:59.598499 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: floatingip_pools.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.598713 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP Pools Extension" alias="floatingip-pools" description="Provides a floating IP pools API." updated="2018-03-21T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.598863 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: floatingip-pools Feb 16 18:12:59.598929 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: ip_allocation.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.599118 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="IP Allocation" alias="ip_allocation" description="IP allocation extension." updated="2016-06-10T23:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.599263 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension ip_allocation not supported by any of loaded plugins Feb 16 18:12:59.599334 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: ip_substring_port_filtering.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.599515 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="IP address substring filtering" alias="ip-substring-filtering" description="Provides IP address substring filtering when listing ports" updated="2017-11-28T09:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.599650 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension ip-substring-filtering not supported by any of loaded plugins Feb 16 18:12:59.599721 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l2_adjacency.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.599898 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="L2 Adjacency" alias="l2_adjacency" description="Display L2 Adjacency for Neutron Networks." updated="2016-04-12T16:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.600036 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension l2_adjacency not supported by any of loaded plugins Feb 16 18:12:59.600105 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.600464 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron L3 Router" alias="router" description="Router abstraction for basic L3 forwarding between L2 Neutron networks and access to external networks via a NAT gateway." updated="2012-07-20T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.600608 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: router Feb 16 18:12:59.600677 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_conntrack_helper.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.601151 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="L3 Conntrack helper" alias="l3-conntrack-helper" description="Allow adding CT target rules for conntrack helper" updated="2019-04-04T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.601310 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension l3-conntrack-helper not supported by any of loaded plugins Feb 16 18:12:59.601374 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_enable_default_route_bfd.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.601574 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Enable Default Route BFD" alias="enable-default-route-bfd" description="Enables configurable BFD behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.601713 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: enable-default-route-bfd Feb 16 18:12:59.601778 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_enable_default_route_ecmp.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.601979 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Enable Default Route ECMP" alias="enable-default-route-ecmp" description="Enables configurable ECMP behavior for default routes" updated="2023-02-27T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.602109 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: enable-default-route-ecmp Feb 16 18:12:59.602201 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_ext_gw_mode.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.602386 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron L3 Configurable external gateway mode" alias="ext-gw-mode" description="Extension of the router abstraction for specifying whether SNAT should occur on the external gateway" updated="2013-03-28T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.602517 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: ext-gw-mode Feb 16 18:12:59.602596 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_ext_ha_mode.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.602765 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="HA Router extension" alias="l3-ha" description="Adds HA capability to routers." updated="2014-04-26T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.602900 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: l3-ha Feb 16 18:12:59.602971 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_ext_ndp_proxy.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.603156 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Router support to enable NDP proxy" alias="l3-ext-ndp-proxy" description="Router extension to enable ndp proxy" updated="2020-08-25T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.603307 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension l3-ext-ndp-proxy not supported by any of loaded plugins Feb 16 18:12:59.603364 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_extra_gws.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.603547 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron L3 External Gateway Multihoming" alias="external-gateway-multihoming" description="Allow multiple external gateway ports per router" updated="2023-01-18T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.603683 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: external-gateway-multihoming Feb 16 18:12:59.603753 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_flavors.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.603928 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Router Flavor Extension" alias="l3-flavors" description="Flavor support for routers." updated="2016-05-17T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.604060 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: l3-flavors Feb 16 18:12:59.604193 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_ndp_proxy.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.604436 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="name" alias="l3-ndp-proxy" description="description" updated="2021-06-29T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.604569 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension l3-ndp-proxy not supported by any of loaded plugins Feb 16 18:12:59.604631 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3_port_ip_change_not_allowed.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.604817 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Prevent L3 router ports IP address change extension" alias="l3-port-ip-change-not-allowed" description="Prevent change of IP address for some L3 router ports" updated="2018-10-09T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.604954 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension l3-port-ip-change-not-allowed not supported by any of loaded plugins Feb 16 18:12:59.605026 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: l3agentscheduler.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.605460 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="L3 Agent Scheduler" alias="l3_agent_scheduler" description="Schedule routers among l3 agents" updated="2013-02-07T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.605627 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension l3_agent_scheduler not supported by any of loaded plugins Feb 16 18:12:59.605698 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: local_ip.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.605950 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Local IP" alias="local_ip" description="Support Node Local Virtual IP" updated="2021-07-26T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.606091 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension local_ip not supported by any of loaded plugins Feb 16 18:12:59.606182 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: logging.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.606422 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Logging API Extension" alias="logging" description="Provides a logging API for resources such as security group and firewall." updated="2017-01-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.606588 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension logging not supported by any of loaded plugins Feb 16 18:12:59.606660 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: metering.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.606901 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Metering" alias="metering" description="Neutron Metering extension." updated="2013-06-12T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.607039 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension metering not supported by any of loaded plugins Feb 16 18:12:59.607112 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: metering_source_and_destination_fields.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.607322 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Metering with source and destination filtering" alias="metering_source_and_destination_fields" description="Neutron Metering extension that enables the use of source and destination IP prefixes to create metering label rules." updated="2020-08-21T08:12:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.607461 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension metering_source_and_destination_fields not supported by any of loaded plugins Feb 16 18:12:59.607532 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: multiprovidernet.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.607710 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Multi Provider Network" alias="multi-provider" description="Expose mapping of virtual networks to multiple physical networks" updated="2013-06-27T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.607848 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: multi-provider Feb 16 18:12:59.607919 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: netmtu.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.608117 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Network MTU" alias="net-mtu" description="Provides MTU attribute for a network resource." updated="2015-03-25T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.608302 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: net-mtu Feb 16 18:12:59.608375 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: netmtu_writable.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.608553 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Network MTU (writable)" alias="net-mtu-writable" description="Provides a writable MTU attribute for a network resource." updated="2017-07-12T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.608809 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: net-mtu-writable Feb 16 18:12:59.608887 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: network_availability_zone.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.609092 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Network Availability Zone" alias="network_availability_zone" description="Availability zone support for network." updated="2015-01-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.609254 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: network_availability_zone Feb 16 18:12:59.609326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: network_ha.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.609506 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Network HA creation flag" alias="network_ha" description="Network high availability creation flag." updated="2023-04-27T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.609642 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension network_ha not supported by any of loaded plugins Feb 16 18:12:59.609714 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: network_ip_availability.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.609904 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Network IP Availability" alias="network-ip-availability" description="Provides IP availability data for each network and subnet." updated="2015-09-24T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.610042 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: network-ip-availability Feb 16 18:12:59.610113 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: network_ip_availability_details.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.610328 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Network IP Availability Details Extension" alias="network-ip-availability-details" description="Add ip_availability_details attribute to network-ip-availabilities resource." updated="2025-10-31T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.610464 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: network-ip-availability-details Feb 16 18:12:59.610537 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: network_segment_range.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.610780 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Network Segment Range" alias="network-segment-range" description="Provides support for the network segment range management" updated="2018-11-29T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.610916 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension network-segment-range not supported by any of loaded plugins Feb 16 18:12:59.610988 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: pagination.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.611194 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Pagination support" alias="pagination" description="Extension that indicates that pagination is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.611273 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: pagination Feb 16 18:12:59.611344 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_device_profile.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.611517 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port device profile" alias="port-device-profile" description="Expose the port device profile (Cyborg)" updated="2020-12-17T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.611656 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: port-device-profile Feb 16 18:12:59.611726 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_hardware_offload_type.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.611902 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port hardware offload" alias="port-hardware-offload-type" description="Expose port hardware offload extension" updated="2023-05-09T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.612064 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-hardware-offload-type not supported by any of loaded plugins Feb 16 18:12:59.612146 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_hint_ovs_tx_steering.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.612340 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port hint: Open vSwitch Tx steering" alias="port-hint-ovs-tx-steering" description="Enable Port hint: Open vSwitch Tx steering" updated="2023-01-01T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.612475 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-hint-ovs-tx-steering not supported by any of loaded plugins Feb 16 18:12:59.612545 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_hints.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.612720 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port hints" alias="port-hints" description="Backend specific port hints to allow backend specific tuning" updated="2023-01-01T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.612855 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-hints not supported by any of loaded plugins Feb 16 18:12:59.612926 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_mac_address_override.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.613101 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Port MAC address override" alias="port-mac-override" description="Allow overriding the MAC address of a direct-physical Port via the active binding profile" updated="2022-03-18T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.613255 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-mac-override not supported by any of loaded plugins Feb 16 18:12:59.613326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_mac_address_regenerate.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.613501 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Port MAC address regenerate" alias="port-mac-address-regenerate" description="Network port MAC address regenerate" updated="2018-05-03T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.613634 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: port-mac-address-regenerate Feb 16 18:12:59.613706 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_numa_affinity_policy.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.613878 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port NUMA affinity policy" alias="port-numa-affinity-policy" description="Expose the port NUMA affinity policy" updated="2020-07-08T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.614013 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: port-numa-affinity-policy Feb 16 18:12:59.614084 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_numa_affinity_policy_socket.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.614277 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port NUMA affinity policy "socket"" alias="port-numa-affinity-policy-socket" description="Adds "socket" to the supported port NUMA affinity policies" updated="2024-02-09T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.614412 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: port-numa-affinity-policy-socket Feb 16 18:12:59.614483 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_resource_request.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.614657 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port Resource Request" alias="port-resource-request" description="Expose resource request to Port" updated="2018-05-08T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.614792 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-resource-request not supported by any of loaded plugins Feb 16 18:12:59.614863 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_resource_request_groups.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.615045 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port Resource Request Groups" alias="port-resource-request-groups" description="Support requesting multiple groups of resources and traits from the same RP subtree in resource_request" updated="2021-08-02T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.615197 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-resource-request-groups not supported by any of loaded plugins Feb 16 18:12:59.615270 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: port_trusted_vif.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.615448 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port trusted vif" alias="port-trusted-vif" description="Expose port 'trusted' attribute in the API" updated="2024-07-10T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.615590 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-trusted-vif not supported by any of loaded plugins Feb 16 18:12:59.615662 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: portbindings.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.615838 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port Binding" alias="binding" description="Expose port bindings of a virtual port to external application" updated="2014-02-03T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.616017 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: binding Feb 16 18:12:59.616086 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: portbindings_extended.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.616317 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port Bindings Extended" alias="binding-extended" description="Expose port bindings of a virtual port to external application" updated="2017-07-17T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.616453 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: binding-extended Feb 16 18:12:59.616524 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: portsecurity.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.616700 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port Security" alias="port-security" description="Provides port security" updated="2012-07-23T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.616837 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: port-security Feb 16 18:12:59.616908 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: project_id.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.617094 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="project_id field enabled" alias="project-id" description="Extension that indicates that project_id field is enabled." updated="2016-09-09T09:09:09-09:09" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.617190 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: project-id Feb 16 18:12:59.617258 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: providernet.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.617433 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Provider Network" alias="provider" description="Expose mapping of virtual networks to physical networks" updated="2012-09-07T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.617573 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: provider Feb 16 18:12:59.617645 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qinq.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.617839 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QinQ networks" alias="qinq" description="Expose network 'qinq' attribute in the API. This allows to configure network to allow vlan in vlan configuration using 0x8a88 ethertype (QinQ)." updated="2024-12-02T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.617981 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: qinq Feb 16 18:12:59.618055 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.618729 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Quality of Service" alias="qos" description="The Quality of Service extension." updated="2015-06-08T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.618871 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos not supported by any of loaded plugins Feb 16 18:12:59.618939 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_bw_limit_direction.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.619160 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Direction for QoS bandwidth limit rule" alias="qos-bw-limit-direction" description="Allow to configure QoS bandwidth limit rule with specific direction: ingress or egress" updated="2017-04-10T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.619312 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-bw-limit-direction not supported by any of loaded plugins Feb 16 18:12:59.619380 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_bw_minimum_ingress.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.619573 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Ingress direction for QoS minimum bandwidth rule" alias="qos-bw-minimum-ingress" description="Allow to configure QoS minumum bandwidth rule with ingress direction." updated="2018-07-09T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.619698 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-bw-minimum-ingress not supported by any of loaded plugins Feb 16 18:12:59.619769 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_default.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.619974 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QoS default policy" alias="qos-default" description="Expose the QoS default policy per project" updated="2017-041-06T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.620104 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-default not supported by any of loaded plugins Feb 16 18:12:59.620212 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_fip.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.620388 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Floating IP QoS" alias="qos-fip" description="The floating IP Quality of Service extension" updated="2017-07-20T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.620529 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-fip not supported by any of loaded plugins Feb 16 18:12:59.620595 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_fip_network_policy.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.620773 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QoS floating IP network policy ID" alias="qos-fip-network-policy" description="Adds a the QoS network ID to the floating IP definition" updated="2021-11-15T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.620915 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-fip-network-policy not supported by any of loaded plugins Feb 16 18:12:59.620986 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_gateway_ip.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.621175 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Router gateway IP QoS" alias="qos-gateway-ip" description="The Router gateway IP Quality of Service extension" updated="2018-02-24T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.621311 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-gateway-ip not supported by any of loaded plugins Feb 16 18:12:59.621382 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_port_network_policy.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.621555 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QoS port network policy ID" alias="qos-port-network-policy" description="Adds a the QoS network ID to the port definition" updated="2019-11-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.621690 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-port-network-policy not supported by any of loaded plugins Feb 16 18:12:59.621761 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_pps_minimum_rule.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.621948 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QoS minimum packet rate rule" alias="qos-pps-minimum" description="Allow to configure QoS minimum packet rate rule." updated="2021-07-14T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.622081 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-pps-minimum not supported by any of loaded plugins Feb 16 18:12:59.622169 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_pps_minimum_rule_alias.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.622355 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QoS minimum packet rate rule alias" alias="qos-pps-minimum-rule-alias" description="API to enable GET, PUT and DELETE operations on QoS minimum packet rate rule without specifying policy ID" updated="2021-10-22T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.622497 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-pps-minimum-rule-alias not supported by any of loaded plugins Feb 16 18:12:59.622568 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_pps_rule.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.622764 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="QoS Rule Type Packet per Second Extension" alias="qos-pps" description="Add QoS Rule Type Packet per Second" updated="2021-05-12T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.622900 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-pps not supported by any of loaded plugins Feb 16 18:12:59.622967 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_rule_type_details.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.623155 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Details of QoS rule types" alias="qos-rule-type-details" description="Expose details about QoS rule types supported by loaded backend drivers" updated="2017-06-22T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.623298 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-rule-type-details not supported by any of loaded plugins Feb 16 18:12:59.623368 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_rule_type_filter.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.623543 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Allow to filter the list of QoS rule types" alias="qos-rule-type-filter" description="Allows to filter the QoS rule type list adding two new flags. "all_rules" prints all implemented QoS rule types."all_supported" prints all supported QoS rule types by the loaded mechanism drivers" updated="2022-02-02T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.623676 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-rule-type-filter not supported by any of loaded plugins Feb 16 18:12:59.623747 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: qos_rules_alias.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.623951 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Quality of Service rules alias API" alias="qos-rules-alias" description="API to enable GET, PUT and DELETE operations on QoS policy rules without specifying policy ID" updated="2018-10-07T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.624090 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension qos-rules-alias not supported by any of loaded plugins Feb 16 18:12:59.624192 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: quota_check_limit.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.624369 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Quota engine limit check" alias="quota-check-limit" description="Support for checking the resource usage before applying a new quota limit" updated="2021-09-08T16:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.624506 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: quota-check-limit Feb 16 18:12:59.624576 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: quota_check_limit_default.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.624771 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Quota engine limit check by default" alias="quota-check-limit-default" description="By default, the Neutron quota engine checks the resource usage before applying a new quota limit" updated="2024-08-21T16:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.624906 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: quota-check-limit-default Feb 16 18:12:59.624977 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: quotasv2.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.625341 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Quota management support" alias="quotas" description="Expose functions for quotas management per project" updated="2012-07-29T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.625418 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: quotas Feb 16 18:12:59.625503 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: quotasv2_detail.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.625780 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Quota details management support" alias="quota_details" description="Expose functions for quotas usage statistics per project" updated="2017-02-10T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.625857 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: quota_details Feb 16 18:12:59.625924 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: rbac.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.626437 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="RBAC Policies" alias="rbac-policies" description="Allows creation and modification of policies that control tenant access to resources." updated="2015-06-17T12:15:12-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.626589 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: rbac-policies Feb 16 18:12:59.626658 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: rbac_address_group.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.626850 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Add address_group type to RBAC" alias="rbac-address-group" description="Add address_group type to network RBAC" updated="2021-01-20T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.626991 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension rbac-address-group not supported by any of loaded plugins Feb 16 18:12:59.627059 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: rbac_address_scope.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.627264 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Add address_scope type to RBAC" alias="rbac-address-scope" description="Add address_scope type to RBAC" updated="2020-02-12T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.627394 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: rbac-address-scope Feb 16 18:12:59.627468 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: rbac_security_groups.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.627653 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Add security_group type to network RBAC" alias="rbac-security-groups" description="Add security_group type to network RBAC" updated="2019-02-14T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.627783 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: rbac-security-groups Feb 16 18:12:59.627893 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: rbac_subnetpool.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.628069 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Add subnetpool type to RBAC" alias="rbac-subnetpool" description="Add subnetpool type to RBAC" updated="2020-02-05T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.628240 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension rbac-subnetpool not supported by any of loaded plugins Feb 16 18:12:59.628311 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: revisionifmatch.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.628486 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="If-Match constraints based on revision_number" alias="revision-if-match" description="Extension indicating that If-Match based on revision_number is supported." updated="2016-12-11T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.628622 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: revision-if-match Feb 16 18:12:59.628694 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: revisions.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.628887 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Resource revision numbers" alias="standard-attr-revisions" description="This extension will display the revision number of neutron resources." updated="2016-04-11T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.629018 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: standard-attr-revisions Feb 16 18:12:59.629090 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: router_availability_zone.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.629307 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Router Availability Zone" alias="router_availability_zone" description="Availability zone support for router." updated="2015-01-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.629447 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: router_availability_zone Feb 16 18:12:59.629519 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: router_enable_snat.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.629698 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Exposes the router "enable_snat" read-only configuration flag" alias="router-enable-snat" description="Exposes the router "enable_snat" read-only configuration flag" updated="2025-09-18T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.629837 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: router-enable-snat Feb 16 18:12:59.629918 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: routerservicetype.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.630094 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Router Service Type" alias="router-service-type" description="Provides router service type" updated="2013-01-29T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.630249 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension router-service-type not supported by any of loaded plugins Feb 16 18:12:59.630321 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: security_groups_default_rules.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.630653 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Default rules for security groups" alias="security-groups-default-rules" description="Configure set of security group rules used as default rules for every new security group" updated="2022-12-19T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.630795 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: security-groups-default-rules Feb 16 18:12:59.630861 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: security_groups_normalized_cidr.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.631047 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Normalized CIDR field for security group rules" alias="security-groups-normalized-cidr" description="Add new field with normalized remote_ip_prefix cidr in SG rule" updated="2020-07-28T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.631208 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: security-groups-normalized-cidr Feb 16 18:12:59.631268 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: security_groups_port_filtering.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.631456 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Port filtering on security groups" alias="port-security-groups-filtering" description="Provides security groups filtering when listing ports" updated="2018-01-09T09:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.631586 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension port-security-groups-filtering not supported by any of loaded plugins Feb 16 18:12:59.631658 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: security_groups_remote_address_group.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.631861 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Remote address group id field for security group rules" alias="security-groups-remote-address-group" description="Add new field of remote address group id in SG rules" updated="2020-08-25T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.631992 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: security-groups-remote-address-group Feb 16 18:12:59.632064 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: security_groups_rules_belongs_to_default_sg.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.632299 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Security group rule belongs to the project's default security group" alias="security-groups-rules-belongs-to-default-sg" description="Flag to determine if the security group rule belongs to the project's default security group" updated="2023-05-23T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.632436 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: security-groups-rules-belongs-to-default-sg Feb 16 18:12:59.632508 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: security_groups_shared_filtering.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.632683 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Security group filtering on the shared field" alias="security-groups-shared-filtering" description="Support filtering security groups on the shared field" updated="2021-10-05T09:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.632820 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: security-groups-shared-filtering Feb 16 18:12:59.632896 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: securitygroup.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.634194 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="security-group" alias="security-group" description="The security groups extension." updated="2012-10-05T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.634335 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: security-group Feb 16 18:12:59.634408 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: segment.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.634656 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Segment" alias="segment" description="Segments extension." updated="2016-02-24T17:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.634795 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension segment not supported by any of loaded plugins Feb 16 18:12:59.634847 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: segments_peer_subnet_host_routes.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.635047 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Segments peer-subnet host routes" alias="segments-peer-subnet-host-routes" description="Add host routes to subnets on a routed network (segments)" updated="2018-06-12T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.635193 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension segments-peer-subnet-host-routes not supported by any of loaded plugins Feb 16 18:12:59.635251 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: servicetype.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.635449 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Neutron Service Type Management" alias="service-type" description="API for retrieving service providers for Neutron advanced services" updated="2013-01-20T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.635589 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: service-type Feb 16 18:12:59.635660 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: sorting.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.635859 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Sorting support" alias="sorting" description="Extension that indicates that sorting is enabled." updated="2016-06-12T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.635940 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: sorting Feb 16 18:12:59.636013 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: standard_attr_segment.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.636214 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Standard Attribute Segment Extension" alias="standard-attr-segment" description="Add standard attributes to Segment resource" updated="2018-04-09T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.636352 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension standard-attr-segment not supported by any of loaded plugins Feb 16 18:12:59.636425 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: standardattrdescription.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.636657 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="standard-attr-description" alias="standard-attr-description" description="Extension to add descriptions to standard attributes" updated="2016-02-10T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.636794 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: standard-attr-description Feb 16 18:12:59.636855 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: stateful_security_group.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.637040 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Stateful security group" alias="stateful-security-group" description="Indicates if the security group is stateful or not" updated="2019-11-26T09:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.637196 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: stateful-security-group Feb 16 18:12:59.637268 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: stdattrs_common.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.637421 np0000155649 neutron-ovn-maintenance-worker[104742]: WARNING neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Did not find expected name "Stdattrs_common" in /opt/stack/neutron/neutron/extensions/stdattrs_common.py Feb 16 18:12:59.637487 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnet_dns_publish_fixed_ip.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.637664 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet DNS publish fixed IP" alias="subnet-dns-publish-fixed-ip" description="Support choosing to publish DNS records for IPs from a subnet" updated="2019-05-24T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.637803 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: subnet-dns-publish-fixed-ip Feb 16 18:12:59.637875 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnet_external_network.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.638053 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet belongs to an external network" alias="subnet-external-network" description="Informs if the subnet belongs to an external network" updated="2024-02-05T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.638210 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: subnet-external-network Feb 16 18:12:59.638265 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnet_onboard.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.638470 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet Onboard" alias="subnet_onboard" description="Provides support for onboarding subnets into subnet pools" updated="2018-12-18T09:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.638608 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension subnet_onboard not supported by any of loaded plugins Feb 16 18:12:59.638680 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnet_segmentid_writable.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.638853 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet SegmentID (writable)" alias="subnet-segmentid-writable" description="Provides a writable segment_id attribute for a subnet resource." updated="2018-03-12T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.638989 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension subnet-segmentid-writable not supported by any of loaded plugins Feb 16 18:12:59.639061 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnet_service_types.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.639259 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet service types" alias="subnet-service-types" description="Provides ability to set the subnet service_types field" updated="2016-03-15T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.639598 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: subnet-service-types Feb 16 18:12:59.639598 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnetallocation.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.639693 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet Allocation" alias="subnet_allocation" description="Enables allocation of subnets from a subnet pool" updated="2015-03-30T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.639826 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: subnet_allocation Feb 16 18:12:59.639887 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: subnetpool_prefix_ops.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.640104 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Subnet Pool Prefix Operations" alias="subnetpool-prefix-ops" description="Provides support for adjusting the prefix list of subnet pools" updated="2019-02-08T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.640267 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: subnetpool-prefix-ops Feb 16 18:12:59.640344 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: tag_creation.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.640638 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Tag creation extension" alias="tag-creation" description="Allow to create multiple tags for a resource" updated="2024-23-07T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.640781 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: tag-creation Feb 16 18:12:59.640830 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: tag_ports_during_bulk_creation.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.641102 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Tag Ports During Bulk Creation" alias="tag-ports-during-bulk-creation" description="Allow to tag ports during bulk creation" updated="2019-12-29T19:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.641187 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension tag-ports-during-bulk-creation not supported by any of loaded plugins Feb 16 18:12:59.641238 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: tagging.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.641816 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Tag support for resources with standard attribute: port, subnet, subnetpool, network, security_group, router, floatingip, policy, trunk, network_segment_range" alias="standard-attr-tag" description="Enables to set tag on resources with standard attribute." updated="2017-01-01T00:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.641922 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: standard-attr-tag Feb 16 18:12:59.641987 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: timestamp.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.642237 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Resource timestamps" alias="standard-attr-timestamp" description="Adds created_at and updated_at fields to all Neutron resources that have Neutron standard attributes." updated="2016-09-12T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.642355 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: standard-attr-timestamp Feb 16 18:12:59.642418 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: trunk.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.642621 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Trunk Extension" alias="trunk" description="Provides support for trunk ports" updated="2016-01-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.642750 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension trunk not supported by any of loaded plugins Feb 16 18:12:59.642816 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: trunk_details.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.643008 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Trunk port details" alias="trunk-details" description="Expose trunk port details" updated="2016-01-01T10:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.643145 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension trunk-details not supported by any of loaded plugins Feb 16 18:12:59.643234 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: uplink_status_propagation.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.643418 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Uplink status propagation extension" alias="uplink-status-propagation" description="Provides ability to propagate port uplink status." updated="2018-05-31T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.643555 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension uplink-status-propagation not supported by any of loaded plugins Feb 16 18:12:59.643627 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: uplink_status_propagation_updatable.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.643823 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Uplink status propagation updatable extension" alias="uplink-status-propagation-updatable" description="Provides ability to update the port uplink status." updated="2024-09-03T18:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.643962 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Extension uplink-status-propagation-updatable not supported by any of loaded plugins Feb 16 18:12:59.644033 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loading extension file: vlantransparent.py {{(pid=104742) _load_all_extensions_from_path /opt/stack/neutron/neutron/api/extensions.py:449}} Feb 16 18:12:59.644267 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Ext name="Vlantransparent" alias="vlan-transparent" description="Provides Vlan Transparent Networks" updated="2015-03-23T09:00:00-00:00" {{(pid=104742) _check_extension /opt/stack/neutron/neutron/api/extensions.py:415}} Feb 16 18:12:59.644441 np0000155649 neutron-ovn-maintenance-worker[104742]: INFO neutron.api.extensions [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Loaded extension: vlan-transparent Feb 16 18:12:59.646058 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Full set of CONF: {{(pid=104742) _load_service_manager_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:59}} Feb 16 18:12:59.646114 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ******************************************************************************** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2804}} Feb 16 18:12:59.646215 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Configuration options gathered from: {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2805}} Feb 16 18:12:59.646262 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2806}} Feb 16 18:12:59.646380 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2807}} Feb 16 18:12:59.646423 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ================================================================================ {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2809}} Feb 16 18:12:59.646556 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] agent_down_time = 75 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.646636 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] allow_automatic_dhcp_failover = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.646725 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] allow_bulk = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.646883 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.646973 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] api_extensions_path = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647061 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] api_paste_config = api-paste.ini {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647174 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] api_workers = 4 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647262 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] auth_strategy = keystone {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647350 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] backlog = 4096 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647438 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] base_mac = fa:16:3e:00:00:00 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647543 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] bind_host = 0.0.0.0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647676 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] bind_port = 9696 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647736 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] client_socket_timeout = 900 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647840 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] config_dir = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647890 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.647991 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] config_source = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648083 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] control_exchange = neutron {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648196 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] core_plugin = ml2 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648282 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] debug = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648372 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] default_availability_zones = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648519 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648606 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] dhcp_agent_notification = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648692 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] dhcp_agents_per_network = 1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648774 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] dhcp_lease_duration = 86400 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648866 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] dhcp_load_type = networks {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.648963 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] dns_domain = openstacklocal {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649055 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649153 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_default_route_bfd = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649246 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_default_route_ecmp = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649333 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_dvr = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649416 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_new_agents = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649501 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_services_on_agents_with_admin_state_down = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649584 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_snat_by_default = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649667 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] enable_traditional_dhcp = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649751 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] external_dns_driver = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649834 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] filter_validation = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649923 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] global_physnet_mtu = 1430 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.649987 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] graceful_shutdown_timeout = 60 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650110 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] host = np0000155649 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650216 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] host_dvr_for_dhcp = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650304 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] http_retries = 3 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650390 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] instance_format = [instance: %(uuid)s] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650480 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650570 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ipam_driver = internal {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650653 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ipv6_pd_enabled = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650738 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] l3_ha = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650825 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650913 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] l3_ha_network_physical_name = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.650999 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] l3_ha_network_type = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651086 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_color = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651199 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_config_append = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651288 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651374 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_dir = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651458 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_file = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651524 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_options = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651642 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_rotate_interval = 1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651733 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_rotate_interval_type = days {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651823 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] log_rotation_type = none {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651896 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.651960 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652047 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652114 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652197 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652302 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_allowed_address_pair = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652362 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_dns_nameservers = 5 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652466 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_header_line = 16384 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652537 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_l3_agents_per_router = 3 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652626 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_logfile_count = 30 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652687 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_logfile_size_mb = 200 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652790 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_routes = 30 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652873 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] max_subnet_host_routes = 20 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.652961 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] my_ip = 199.204.45.210 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653048 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] my_ipv6 = 2604:e100:1:0:f816:3eff:fef1:b535 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653111 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] network_auto_schedule = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653231 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] network_link_prefix = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653318 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653392 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] notify_nova_on_port_data_changes = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653490 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] notify_nova_on_port_status_changes = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653756 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] pagination_max_limit = -1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653823 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] periodic_fuzzy_delay = 5 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.653920 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] periodic_interval = 40 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654001 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] publish_errors = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654086 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rate_limit_burst = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654195 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rate_limit_except_level = CRITICAL {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654269 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rate_limit_interval = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654362 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] retry_until_window = 30 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654445 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] router_distributed = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654530 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rpc_resources_processing_step = 20 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654617 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rpc_response_max_timeout = 600 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654701 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rpc_response_timeout = 60 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654793 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rpc_state_report_workers = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654876 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] rpc_workers = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.654956 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] send_events_interval = 2 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655047 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] service_plugins = ['ovn-router'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655155 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] setproctitle = on {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655231 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] shell_completion = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655321 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] state_path = /opt/stack/data/neutron {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655409 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] syslog_log_facility = LOG_USER {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655498 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] tcp_keepidle = 600 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655610 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] transport_url = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655690 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] use_journal = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655795 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] use_json = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655880 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] use_ssl = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.655965 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] use_stderr = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656052 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] use_syslog = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656153 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] vlan_qinq = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656242 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] vlan_transparent = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656324 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] wsgi_default_pool_size = 100 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656411 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] wsgi_keep_alive = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656498 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656585 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] wsgi_server_debug = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.656682 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_concurrency.disable_process_locking = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.656778 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.656878 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.connection_string = messaging:// {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.656970 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.enabled = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657061 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.es_doc_type = notification {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657186 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.es_scroll_size = 10000 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657248 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.es_scroll_time = 2m {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657343 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.filter_error_trace = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657436 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.hmac_keys = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657545 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.sentinel_service_name = mymaster {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657652 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.socket_timeout = 0.1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657739 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.trace_requests = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657825 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler.trace_sqlalchemy = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.657921 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler_jaeger.process_tags = {} {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658012 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler_jaeger.service_name_prefix = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658100 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] profiler_otlp.service_name_prefix = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658214 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658297 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658387 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_metrics.metrics_process_name = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658478 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658541 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658657 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.enforce_new_defaults = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.658832 np0000155649 neutron-ovn-maintenance-worker[104742]: WARNING oslo_config.cfg [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.). Its value may be silently ignored in the future. Feb 16 18:12:59.658917 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.enforce_scope = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659011 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.policy_default_rule = default {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659108 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659225 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659298 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659398 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659501 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659579 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659665 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659754 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_policy.remote_timeout = 60.0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659850 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.659940 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] service_providers.service_provider = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660034 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.auth_section = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660213 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.auth_type = password {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660265 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.auth_url = https://199.204.45.210/identity {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660309 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660409 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.certfile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660497 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.collect_timing = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660585 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.default_domain_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660671 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.default_domain_name = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660765 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.domain_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660846 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.domain_name = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.660935 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.endpoint_type = public {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661022 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.insecure = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661104 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.keyfile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661210 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.password = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661296 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.project_domain_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661386 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.project_domain_name = Default {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661475 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.project_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661567 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.project_name = service {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661655 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.region_name = RegionOne {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661742 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.split_loggers = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661827 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.system_scope = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661910 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.timeout = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.661988 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.trust_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662075 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.user_domain_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662251 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.user_domain_name = Default {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662251 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.user_id = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662347 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] nova.username = nova {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662443 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.auth_section = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662580 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.auth_type = password {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662626 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662675 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.certfile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662777 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.collect_timing = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.662867 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.endpoint_type = public {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663008 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.insecure = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663008 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.keyfile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663089 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.region_name = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663206 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.split_loggers = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663286 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] placement.timeout = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663375 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.auth_section = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663493 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.auth_type = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663573 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.cafile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663650 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.certfile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663732 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.collect_timing = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663817 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.connect_retries = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.663948 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.connect_retry_delay = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664012 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.enable_notifications = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664080 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.endpoint_override = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664185 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.insecure = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664269 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.interface = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664353 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.keyfile = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664445 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.max_version = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664546 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.min_version = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664638 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.region_name = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664722 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.retriable_status_codes = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.664804 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.service_name = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.service_type = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.split_loggers = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.status_code_retries = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.status_code_retry_delay = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.timeout = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665326 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.valid_interfaces = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665520 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ironic.version = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665520 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] cli_script.dry_run = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665520 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665966 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665966 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665966 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665966 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.665966 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666121 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666121 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666207 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666279 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.hostname = np0000155649 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666363 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666456 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666548 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666633 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666722 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666812 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666898 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.666983 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667073 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667176 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667264 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667352 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667452 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667545 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667632 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667720 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667806 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667894 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.667978 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668080 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668178 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.ssl = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668273 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668361 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668446 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668535 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668625 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.ssl_version = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668707 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668798 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_notifications.driver = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668883 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_notifications.retry = -1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.668978 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669063 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_messaging_notifications.transport_url = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669166 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_reports.file_event_handler = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669256 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_reports.file_event_handler_interval = 1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669341 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_reports.log_dir = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669431 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669524 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.default_quota = -1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669613 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669698 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_floatingip = 50 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669783 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_network = 100 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669869 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_port = 500 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.669959 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_rbac_policy = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670044 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_router = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670128 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_security_group = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670231 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_security_group_rule = 100 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670316 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.quota_subnet = 100 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670402 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] QUOTAS.track_quota_usage = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670497 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670580 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.group = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670664 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.helper_command = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670750 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.log_daemon_traceback = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670839 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.logger_name = oslo_privsep.daemon {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.670925 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.thread_pool_size = 16 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671008 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep.user = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671098 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.capabilities = [21, 12] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671199 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.group = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671282 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.helper_command = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671391 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.log_daemon_traceback = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671472 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671563 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.thread_pool_size = 16 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671651 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_dhcp_release.user = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671739 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.671822 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.group = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672109 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.helper_command = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672109 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672109 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672218 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672246 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_ovs_vsctl.user = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672333 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.capabilities = [21] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672415 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.group = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672496 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.helper_command = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672580 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.log_daemon_traceback = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672668 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672752 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.thread_pool_size = 16 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672834 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_namespace.user = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.672928 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.capabilities = [12] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673012 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.group = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673093 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.helper_command = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673197 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.log_daemon_traceback = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673286 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673369 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.thread_pool_size = 16 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673452 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_conntrack.user = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673544 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.capabilities = [12, 21] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673628 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.group = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673737 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.helper_command = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673790 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.log_daemon_traceback = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673877 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.logger_name = oslo_privsep.daemon {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.673961 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.thread_pool_size = 16 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674044 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] privsep_link.user = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674154 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674251 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674337 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] AGENT.use_helper_for_ns_read = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674426 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] SECURITYGROUP.enable_ipset = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674515 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] SECURITYGROUP.enable_security_group = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674599 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] SECURITYGROUP.firewall_driver = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674688 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] SECURITYGROUP.permitted_ethertypes = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674775 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] experimental.ipv6_pd_enabled = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674875 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.extension_drivers = ['port_security', 'qos'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.674964 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.external_network_type = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675060 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.mechanism_drivers = ['ovn'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675169 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.overlay_ip_version = 4 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675259 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.path_mtu = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675375 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.physical_network_mtus = {} {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675469 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.tenant_network_types = ['geneve'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675561 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675655 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2.type_drivers = ['local', 'flat', 'vlan', 'geneve'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675752 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2_type_flat.flat_networks = ['public'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675846 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2_type_geneve.max_header_size = 38 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.675947 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2_type_geneve.vni_ranges = ['1:65536'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676042 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676144 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] network_log.burst_limit = 25 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676235 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] network_log.local_output_log_base = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676321 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] network_log.rate_limit = 100 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676412 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.asyncio_connection = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676496 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.asyncio_slave_connection = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676587 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.backend = sqlalchemy {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676677 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.connection = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676763 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.connection_debug = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676853 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.connection_parameters = {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.676939 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.connection_recycle_time = 3600 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677022 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.connection_trace = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677108 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.db_inc_retry_interval = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677209 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.db_max_retries = 20 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677297 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.db_max_retry_interval = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677380 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.db_retry_interval = 1 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677465 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.max_overflow = 50 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677551 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.max_pool_size = 5 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677636 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.max_retries = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677726 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.mysql_sql_mode = TRADITIONAL {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677811 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.mysql_wsrep_sync_wait = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677894 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.pool_timeout = None {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.677978 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.retry_interval = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678063 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.slave_connection = **** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678170 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.sqlite_synchronous = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678259 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.synchronous_reader = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678343 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] database.use_db_reconnect = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678436 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.broadcast_arps_to_all_routers = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678522 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.dhcp_default_lease_time = 43200 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678607 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678693 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.dns_records_ovn_owned = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678780 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.dns_servers = [] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678865 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.enable_distributed_floating_ip = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.678951 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.fdb_age_threshold = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679041 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.live_migration_activation_strategy = rarp {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679126 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.localnet_learn_fdb = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679228 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.mac_binding_age_threshold = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679335 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.neutron_sync_mode = log {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679436 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_dhcp4_global_options = {} {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679524 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_dhcp6_global_options = {} {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679612 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_l3_scheduler = leastloaded {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679701 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_metadata_enabled = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679788 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_nb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679877 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_nb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.679972 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_nb_connection = ['ssl:199.204.45.210:6641'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680059 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_nb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680154 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_router_indirect_snat = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680253 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_sb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680342 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_sb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680435 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_sb_connection = ['ssl:199.204.45.210:6642'] {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680524 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovn_sb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680610 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovs_create_tap = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680695 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovsdb_connection_timeout = 180 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680784 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovsdb_log_level = INFO {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680961 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovsdb_probe_interval = 60000 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.680961 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.ovsdb_retry_max_interval = 180 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681028 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.stateless_nat_enabled = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681115 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681225 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVS.bridge_mac_table_size = 50000 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681311 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVS.igmp_flood = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681396 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVS.igmp_flood_reports = True {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681481 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVS.igmp_flood_unregistered = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681572 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVS.igmp_snooping_enable = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681657 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] OVS.ovsdb_timeout = 10 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681748 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn_nb_global.fdb_removal_limit = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681833 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn_nb_global.ignore_lsp_down = False {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681927 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.681992 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG cotyledon.oslo_config_glue [None req-685b5723-4aa3-4f49-a801-17705948ceee None None] ******************************************************************************** {{(pid=104742) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2828}} Feb 16 18:12:59.710761 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] Full set of CONF: {{(pid=105517) _load_service_options /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/oslo_config_glue.py:65}} Feb 16 18:12:59.711361 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2804}} Feb 16 18:12:59.711361 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] Configuration options gathered from: {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2805}} Feb 16 18:12:59.711361 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] command line args: ['--config-file', '/etc/neutron/neutron.conf', '--config-file', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2806}} Feb 16 18:12:59.711361 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] config files: ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2807}} Feb 16 18:12:59.711361 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ================================================================================ {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2809}} Feb 16 18:12:59.711563 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] agent_down_time = 75 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.711610 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] allow_automatic_dhcp_failover = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.711723 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] allow_bulk = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.711996 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] allowed_conntrack_helpers = [{'amanda': 'tcp'}, {'ftp': 'tcp'}, {'h323': 'udp'}, {'h323': 'tcp'}, {'irc': 'tcp'}, {'netbios-ns': 'udp'}, {'pptp': 'tcp'}, {'sane': 'tcp'}, {'sip': 'udp'}, {'sip': 'tcp'}, {'snmp': 'udp'}, {'tftp': 'udp'}] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712121 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] api_extensions_path = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712270 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] api_paste_config = api-paste.ini {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712398 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] api_workers = 4 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712507 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] auth_strategy = keystone {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712626 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] backlog = 4096 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712732 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] base_mac = fa:16:3e:00:00:00 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.712990 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] bind_host = 0.0.0.0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713111 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] bind_port = 9696 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713248 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] client_socket_timeout = 900 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713384 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] config_dir = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713458 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] config_file = ['/etc/neutron/neutron.conf', '/etc/neutron/plugins/ml2/ml2_conf.ini'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713561 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] config_source = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713679 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] control_exchange = neutron {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713787 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] core_plugin = ml2 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.713895 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] debug = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714010 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] default_availability_zones = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714264 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'OFPHandler=INFO', 'OfctlService=INFO', 'os_ken.base.app_manager=INFO', 'os_ken.controller.controller=INFO'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714383 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agent_notification = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714472 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] dhcp_agents_per_network = 1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714577 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] dhcp_lease_duration = 86400 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714713 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] dhcp_load_type = networks {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714822 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] dns_domain = openstacklocal {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.714958 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] dvr_base_mac = fa:16:3f:00:00:00 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715063 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_bfd = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715189 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_default_route_ecmp = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715287 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_dvr = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715409 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_new_agents = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715507 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_services_on_agents_with_admin_state_down = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715618 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_snat_by_default = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715693 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] enable_traditional_dhcp = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715789 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] external_dns_driver = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715835 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] fatal_deprecations = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.715934 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] filter_validation = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716034 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] global_physnet_mtu = 1430 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716124 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] graceful_shutdown_timeout = 60 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716482 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] host = np0000155649 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716582 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] host_dvr_for_dhcp = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716669 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] http_retries = 3 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716772 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] instance_format = [instance: %(uuid)s] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716868 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.716980 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ipam_driver = internal {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717056 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ipv6_pd_enabled = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717192 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] l3_ha = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717352 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_net_cidr = 169.254.192.0/18 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717396 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_physical_name = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717475 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] l3_ha_network_type = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717563 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_color = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717665 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_config_append = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717755 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717854 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_dir = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.717938 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_file = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718000 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_options = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718083 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval = 1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718219 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_rotate_interval_type = days {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718309 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] log_rotation_type = none {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718414 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718479 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718525 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718631 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718697 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718794 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_allowed_address_pair = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.718921 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_dns_nameservers = 5 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719006 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_header_line = 16384 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719087 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_l3_agents_per_router = 3 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719222 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_count = 30 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719306 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_logfile_size_mb = 200 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719411 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_routes = 30 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719511 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] max_subnet_host_routes = 20 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719610 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] my_ip = 199.204.45.210 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719686 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] my_ipv6 = 2604:e100:1:0:f816:3eff:fef1:b535 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719759 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] network_auto_schedule = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719825 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] network_link_prefix = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719910 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] network_scheduler_driver = neutron.scheduler.dhcp_agent_scheduler.WeightScheduler {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.719964 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_data_changes = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720028 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] notify_nova_on_port_status_changes = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720107 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] pagination_max_limit = -1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720204 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] periodic_fuzzy_delay = 5 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720298 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] periodic_interval = 40 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720380 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] publish_errors = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720434 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_burst = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720495 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_except_level = CRITICAL {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720548 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rate_limit_interval = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720601 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] retry_until_window = 30 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720686 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] router_distributed = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720749 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rpc_resources_processing_step = 20 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720814 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_max_timeout = 600 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720873 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rpc_response_timeout = 60 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.720946 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rpc_state_report_workers = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721078 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] rpc_workers = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721197 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] send_events_interval = 2 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721271 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] service_plugins = ['ovn-router'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721360 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] setproctitle = on {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721360 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] shell_completion = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721487 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] state_path = /opt/stack/data/neutron {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721487 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] syslog_log_facility = LOG_USER {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721597 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] tcp_keepidle = 600 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721669 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] transport_url = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721728 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] use_journal = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721786 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] use_json = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721786 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] use_ssl = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721894 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] use_stderr = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721962 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] use_syslog = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.721962 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] vlan_qinq = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.722080 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] vlan_transparent = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.722080 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] wsgi_default_pool_size = 100 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.722235 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] wsgi_keep_alive = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.722235 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.722356 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] wsgi_server_debug = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2817}} Feb 16 18:12:59.722415 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.disable_process_locking = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.722510 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_concurrency.lock_path = /opt/stack/data/neutron/lock {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.722625 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.connection_string = messaging:// {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.722699 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.enabled = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.722760 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_doc_type = notification {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.722871 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_size = 10000 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.722945 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.es_scroll_time = 2m {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723006 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.filter_error_trace = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723064 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.hmac_keys = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723192 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.sentinel_service_name = mymaster {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723268 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.socket_timeout = 0.1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723358 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_requests = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723419 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler.trace_sqlalchemy = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723479 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.process_tags = {} {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723537 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler_jaeger.service_name_prefix = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723596 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] profiler_otlp.service_name_prefix = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723683 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723747 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723816 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723876 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.723925 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724040 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_new_defaults = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724103 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.enforce_scope = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724159 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_default_rule = default {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724214 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724261 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.policy_file = /etc/neutron/policy.json {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724319 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724353 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724407 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724441 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724484 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724536 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_policy.remote_timeout = 60.0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724604 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724723 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] service_providers.service_provider = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724840 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_section = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.724927 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_type = password {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725004 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.auth_url = https://199.204.45.210/identity {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725060 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.cafile = /opt/stack/data/ca-bundle.pem {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725103 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.certfile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725174 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.collect_timing = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725216 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725244 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.default_domain_name = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725293 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725344 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.domain_name = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725392 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.endpoint_type = public {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725448 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.insecure = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725481 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.keyfile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725518 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.password = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725575 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725607 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.project_domain_name = Default {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725639 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.project_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725671 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.project_name = service {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725730 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.region_name = RegionOne {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725764 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.split_loggers = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725816 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.system_scope = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725868 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.timeout = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725907 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.trust_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725939 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.725975 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.user_domain_name = Default {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726031 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.user_id = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726069 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] nova.username = nova {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726130 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_section = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726181 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.auth_type = password {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726211 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.cafile = /opt/stack/data/ca-bundle.pem {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726257 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.certfile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726298 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.collect_timing = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726329 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.endpoint_type = public {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726377 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.insecure = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726410 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.keyfile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726447 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.region_name = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726502 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.split_loggers = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726534 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] placement.timeout = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726594 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_section = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726628 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.auth_type = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726669 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.cafile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726705 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.certfile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726782 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.collect_timing = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726843 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retries = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726899 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.connect_retry_delay = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726933 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.enable_notifications = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.726979 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.endpoint_override = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727017 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.insecure = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727049 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.interface = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727086 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.keyfile = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727134 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.max_version = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727200 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.min_version = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727242 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.region_name = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727270 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.retriable_status_codes = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727305 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_name = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727353 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.service_type = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727399 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.split_loggers = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727431 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retries = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727480 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.status_code_retry_delay = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727524 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.timeout = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727552 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.valid_interfaces = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727585 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ironic.version = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727648 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] cli_script.dry_run = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727721 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727767 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727818 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727875 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727909 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727950 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.727983 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728035 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728073 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728106 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.hostname = np0000155649 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728156 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728221 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728263 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728321 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728357 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728410 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.processname = neutron-ovn-maintenance-worker {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728448 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728498 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728538 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728567 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728625 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728655 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728697 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728735 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728774 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728805 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728866 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728901 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728953 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.728994 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729042 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729081 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729110 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729179 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729231 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729260 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.ssl_version = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729311 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_rabbit.use_queue_manager = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729374 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.driver = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729420 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.retry = -1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729474 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729539 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_messaging_notifications.transport_url = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729611 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729663 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729697 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_reports.log_dir = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729764 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729831 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.default_quota = -1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729869 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_driver = neutron.db.quota.driver_nolock.DbQuotaNoLockDriver {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729939 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_floatingip = 50 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.729974 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_network = 100 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730037 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_port = 500 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730075 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_rbac_policy = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730128 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_router = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730184 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730231 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_security_group_rule = 100 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730298 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.quota_subnet = 100 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730354 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] QUOTAS.track_quota_usage = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730496 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.capabilities = [21, 12, 1, 2, 19] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730537 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.group = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730605 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.helper_command = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730679 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.log_daemon_traceback = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730816 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.logger_name = oslo_privsep.daemon {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730892 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.thread_pool_size = 16 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.730977 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep.user = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.capabilities = [21, 12] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.group = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.helper_command = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.log_daemon_traceback = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.logger_name = oslo_privsep.daemon {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.thread_pool_size = 16 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_dhcp_release.user = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731527 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.capabilities = [21, 12] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731527 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.group = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731527 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.helper_command = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731527 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.log_daemon_traceback = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731624 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.logger_name = oslo_privsep.daemon {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731624 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.thread_pool_size = 16 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731687 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_ovs_vsctl.user = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731687 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.capabilities = [21] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731740 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.group = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731792 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.helper_command = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731827 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.log_daemon_traceback = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731872 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.logger_name = oslo_privsep.daemon {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731905 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.thread_pool_size = 16 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731951 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_namespace.user = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.731988 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.capabilities = [12] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732024 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.group = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732074 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.helper_command = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732106 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.log_daemon_traceback = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732167 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.logger_name = oslo_privsep.daemon {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732210 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.thread_pool_size = 16 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732246 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_conntrack.user = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732304 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.capabilities = [12, 21] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732338 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.group = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732372 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.helper_command = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732411 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.log_daemon_traceback = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732447 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.logger_name = oslo_privsep.daemon {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732492 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.thread_pool_size = 16 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732525 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] privsep_link.user = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732588 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper = sudo /opt/stack/data/venv/bin/neutron-rootwrap /etc/neutron/rootwrap.conf {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732622 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] AGENT.root_helper_daemon = sudo /opt/stack/data/venv/bin/neutron-rootwrap-daemon /etc/neutron/rootwrap.conf {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732676 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] AGENT.use_helper_for_ns_read = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732743 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_ipset = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732795 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.enable_security_group = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732835 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.firewall_driver = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732892 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] SECURITYGROUP.permitted_ethertypes = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.732941 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] experimental.ipv6_pd_enabled = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733011 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.extension_drivers = ['port_security', 'qos'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733060 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.external_network_type = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733114 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.mechanism_drivers = ['ovn'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733178 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.overlay_ip_version = 4 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733219 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.path_mtu = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733248 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.physical_network_mtus = {} {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733306 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.tenant_network_types = ['geneve'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733355 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.tunnelled_network_rp_name = rp_tunnelled {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733392 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2.type_drivers = ['local', 'flat', 'vlan', 'geneve'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733470 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_flat.flat_networks = ['public'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733527 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.max_header_size = 38 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733585 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_geneve.vni_ranges = ['1:65536'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733653 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ml2_type_vlan.network_vlan_ranges = ['public'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733719 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] network_log.burst_limit = 25 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733763 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] network_log.local_output_log_base = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733877 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] network_log.rate_limit = 100 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733877 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_connection = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733944 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.asyncio_slave_connection = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.733944 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.backend = sqlalchemy {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734005 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.connection = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734036 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.connection_debug = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734084 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.connection_parameters = {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734151 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.connection_recycle_time = 3600 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734193 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.connection_trace = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734230 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.db_inc_retry_interval = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734277 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retries = 20 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734314 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.db_max_retry_interval = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734346 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.db_retry_interval = 1 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734394 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.max_overflow = 50 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734425 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.max_pool_size = 5 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734474 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.max_retries = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734525 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734563 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.mysql_wsrep_sync_wait = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734595 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.pool_timeout = None {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734644 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.retry_interval = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734710 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.slave_connection = **** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734763 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.sqlite_synchronous = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734811 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.synchronous_reader = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734843 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] database.use_db_reconnect = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734920 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.broadcast_arps_to_all_routers = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.734974 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.dhcp_default_lease_time = 43200 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735007 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.disable_ovn_dhcp_for_baremetal_ports = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735058 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_records_ovn_owned = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735107 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.dns_servers = [] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735174 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.enable_distributed_floating_ip = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735216 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.fdb_age_threshold = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735251 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.live_migration_activation_strategy = rarp {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735292 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.localnet_learn_fdb = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735333 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.mac_binding_age_threshold = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735390 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.neutron_sync_mode = log {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735423 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp4_global_options = {} {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735473 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_dhcp6_global_options = {} {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735541 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_l3_scheduler = leastloaded {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735541 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_metadata_enabled = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735616 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735656 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735692 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_connection = ['ssl:199.204.45.210:6641'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735735 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_nb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735767 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_router_indirect_snat = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735799 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_ca_cert = /opt/stack/data/CA/int-ca/ca-chain.pem {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735834 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_certificate = /opt/stack/data/CA/int-ca/devstack-cert.crt {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735884 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_connection = ['ssl:199.204.45.210:6642'] {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735923 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovn_sb_private_key = /opt/stack/data/CA/int-ca/private/devstack-cert.key {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.735955 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovs_create_tap = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736001 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_connection_timeout = 180 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736033 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_log_level = INFO {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736070 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_probe_interval = 60000 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736119 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.ovsdb_retry_max_interval = 180 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736174 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.stateless_nat_enabled = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736212 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn.vhost_sock_dir = /var/run/openvswitch {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736278 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] OVS.bridge_mac_table_size = 50000 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736311 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736348 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_reports = True {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736398 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_flood_unregistered = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736435 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] OVS.igmp_snooping_enable = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736476 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] OVS.ovsdb_timeout = 10 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736531 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.fdb_removal_limit = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736579 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.ignore_lsp_down = False {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736629 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ovn_nb_global.mac_binding_removal_limit = 0 {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2824}} Feb 16 18:12:59.736661 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon.oslo_config_glue [-] ******************************************************************************** {{(pid=105517) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:2828}} Feb 16 18:12:59.736862 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG cotyledon._service_worker [-] Run service ServiceWrapper(0) [105517] {{(pid=105517) wait_forever /opt/stack/data/venv/lib/python3.12/site-packages/cotyledon/_service_worker.py:218}} Feb 16 18:12:59.737889 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver.OVNMechanismDriver.post_fork_initialize-1017057', 'neutron.services.ovn_l3.plugin.OVNL3RouterPlugin._post_fork_initialize-1194398'] for process (None), after_init {{(pid=105517) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} Feb 16 18:12:59.739999 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbNbOvnIdl for MaintenanceWorker with retry Feb 16 18:12:59.787162 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Switch.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} Feb 16 18:12:59.787317 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Logical_Router.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} Feb 16 18:12:59.787497 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Load_Balancer.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} Feb 16 18:12:59.787786 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Copp.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.787892 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Meter.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788090 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Load_Balancer_Group.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788090 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index HA_Chassis_Group.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788254 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Address_Set.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788397 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Connection.target {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788473 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Gateway_Chassis.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788583 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Mirror.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788697 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Template_Var.chassis {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788792 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Router_Port.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.788910 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Port_Group.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.789024 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Logical_Switch_Port.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.792791 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.210:6641: connecting... Feb 16 18:12:59.799659 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.210:6641: connected Feb 16 18:12:59.827933 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Getting OvsdbSbOvnIdl for MaintenanceWorker with retry Feb 16 18:12:59.857178 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Chassis.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} Feb 16 18:12:59.857355 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created lookup_table index Port_Binding.logical_port {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:87}} Feb 16 18:12:59.857355 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Chassis_Private.name {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.857565 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl [-] Created schema index Datapath_Binding.tunnel_key {{(pid=105517) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Feb 16 18:12:59.859624 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.210:6642: connecting... Feb 16 18:12:59.865442 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO ovsdbapp.backend.ovs_idl.vlog [-] ssl:199.204.45.210:6642: connected Feb 16 18:12:59.899116 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip precommit_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899338 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip precommit_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899338 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899338 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > floatingip before_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899537 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899537 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port precommit_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899744 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.portforwarding.drivers.ovn.driver.OVNPortForwarding.register-588104'] for port_forwarding_plugin (None), after_init {{(pid=105517) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} Feb 16 18:12:59.899829 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899895 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > router_interface after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899970 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.899970 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port_forwarding after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.900082 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > router_interface after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.900208 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension Feb 16 18:12:59.900299 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.placement [-] Starting OVNClientPlacementExtension Feb 16 18:12:59.900887 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment before_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.900986 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet precommit_delete_associations 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901259 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901331 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment_host_mapping after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901396 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901472 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901472 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901597 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > segment after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901597 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901719 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.901719 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.955835 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.955835 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.955835 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet before_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.956131 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > subnet before_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.958128 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.958219 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > port after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.958316 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Publish callbacks ['neutron.services.logapi.drivers.ovn.driver.DriverBase._register-1329203'] for logging-plugin (None), after_init {{(pid=105517) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} Feb 16 18:12:59.958452 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group_rule after_create 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.958526 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group_rule after_update 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:12:59.958583 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [-] Subscribe: > security_group_rule after_delete 55550000, False {{(pid=105517) subscribe /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:52}} Feb 16 18:13:09.444920 np0000155649 neutron-ovn-maintenance-worker[104742]: DEBUG dbcounter [-] [104742] Writing DB stats neutron:SELECT=4 {{(pid=104742) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Feb 16 18:13:09.960066 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Northbound DB sync process started @ 2026-02-16 18:13:09.959589 {{(pid=105517) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:97}} Feb 16 18:13:09.963076 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync port groups started @ 2026-02-16 18:13:09.962672 {{(pid=105517) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:130}} Feb 16 18:13:09.980308 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG dbcounter [-] [105517] Writer thread running {{(pid=105517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Feb 16 18:13:09.995284 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync port groups completed @ 2026-02-16 18:13:09.994919 {{(pid=105517) sync_port_groups /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:194}} Feb 16 18:13:09.995435 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync networks, ports and DHCP options started @ 2026-02-16 18:13:09.995257 {{(pid=105517) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1114}} Feb 16 18:13:10.109866 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.services.segments.db [None req-486018a3-5a02-4012-b845-617857f86440 None None] neutron.services.segments.plugin.Plugin method get_segments called with arguments (,) {'filters': {'network_id': ['9ffe4f07-7278-4e99-8342-27de602e7afe'], 'is_dynamic': False}} {{(pid=105517) wrapper /opt/stack/data/venv/lib/python3.12/site-packages/oslo_log/helpers.py:77}} Feb 16 18:13:10.114070 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync metadata ports started {{(pid=105517) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1059}} Feb 16 18:13:10.169068 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync metadata ports completed {{(pid=105517) _sync_metadata_ports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1111}} Feb 16 18:13:10.169212 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync DHCP options for Neutron subnets started {{(pid=105517) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:911}} Feb 16 18:13:10.438203 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync DHCP options for Neutron subnets completed @ 2026-02-16 18:13:10.437788 {{(pid=105517) _sync_subnet_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:984}} Feb 16 18:13:10.439987 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} Feb 16 18:13:10.439987 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned started {{(pid=105517) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:989}} Feb 16 18:13:10.439987 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync DHCP options for Neutron ports with extra dhcp options assigned completed {{(pid=105517) _sync_port_dhcp_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1048}} Feb 16 18:13:10.439987 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync networks, ports and DHCP options completed @ 2026-02-16 18:13:10.438846 {{(pid=105517) sync_networks_ports_and_dhcp_opts /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1283}} Feb 16 18:13:10.439987 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync ACLs started @ 2026-02-16 18:13:10.438942 {{(pid=105517) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:237}} Feb 16 18:13:10.474550 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync ACLs completed @ 2026-02-16 18:13:10.474226 {{(pid=105517) sync_acls /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:427}} Feb 16 18:13:10.474901 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync routers and router ports started @ 2026-02-16 18:13:10.474522 {{(pid=105517) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:585}} Feb 16 18:13:10.531370 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} Feb 16 18:13:10.531627 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync routers and router ports completed @ 2026-02-16 18:13:10.531255 {{(pid=105517) sync_routers_and_rports /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:906}} Feb 16 18:13:10.531627 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync port QoS policies started @ 2026-02-16 18:13:10.531429 {{(pid=105517) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1331}} Feb 16 18:13:10.531627 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-486018a3-5a02-4012-b845-617857f86440 None None] Starting OVNClientQosExtension Feb 16 18:13:10.547483 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync port QoS policies completed @ 2026-02-16 18:13:10.547233 {{(pid=105517) sync_port_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1354}} Feb 16 18:13:10.547652 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync Floating IP QoS policies started @ 2026-02-16 18:13:10.547462 {{(pid=105517) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1359}} Feb 16 18:13:10.547699 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [None req-486018a3-5a02-4012-b845-617857f86440 None None] Starting OVNClientQosExtension Feb 16 18:13:10.570270 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync Floating IP QoS policies completed @ 2026-02-16 18:13:10.570029 {{(pid=105517) sync_fip_qos_policies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1382}} Feb 16 18:13:10.570379 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync Floating IP NAT rules started @ 2026-02-16 18:13:10.570256 {{(pid=105517) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1387}} Feb 16 18:13:10.570584 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-NB Sync Floating IP NAT rules completed @ 2026-02-16 18:13:10.570467 {{(pid=105517) sync_fip_dnat_rules /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1410}} Feb 16 18:13:10.570660 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-486018a3-5a02-4012-b845-617857f86440 None None] OVN-Northbound DB sync process completed @ 2026-02-16 18:13:10.570564 {{(pid=105517) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:110}} Feb 16 18:13:19.961289 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [-] OVN-Southbound DB sync process started @ 2026-02-16 18:13:19.960862 {{(pid=105517) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1438}} Feb 16 18:13:19.962031 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension Feb 16 18:13:19.963621 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] OVN-SB Sync hostname and physical networks started @ 2026-02-16 18:13:19.963171 {{(pid=105517) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1465}} Feb 16 18:13:19.969362 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.969515 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fair_meter_consistency {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.969641 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_fdb_aging_settings {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.969857 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_igmp_snoop_support {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.970060 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_for_inconsistencies {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.970522 np0000155649 neutron-ovn-maintenance-worker[105517]: WARNING neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] New host np0000155649 found in OVN SB DB, but not in Neutron. Add its SegmentHostMapping in Neutron Feb 16 18:13:19.970867 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_global_dhcp_opts {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.972404 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975241 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975324 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_provider_distributed_ports {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975373 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975523 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975523 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975603 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.configure_nb_global {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975672 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_fip_distributed_flag {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975748 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_network_type_and_physnet {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.975823 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.set_ovn_owned_dns_option {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.976107 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.976202 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_mac_aging_settings {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.976268 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_qos_fip_rule_priority {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.976355 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_distributed_flag {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.976426 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Periodic task found: DBInconsistenciesPeriodics.update_router_static_routes {{(pid=105517) add_periodics /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:97}} Feb 16 18:13:19.978858 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:19.979358 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] Maintenance task thread has started Feb 16 18:13:19.979437 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.mech_driver [-] MaintenanceWorker process has finished the post initialization Feb 16 18:13:19.982495 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:19.984452 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:19.986992 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fair_meter_consistency' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:19.989002 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG oslo_concurrency.lockutils [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] Acquiring lock "update_segment_host_mapping" by "neutron.services.segments.db.update_segment_host_mapping" {{(pid=105517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:506}} Feb 16 18:13:19.989219 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG oslo_concurrency.lockutils [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] Lock "update_segment_host_mapping" acquired by "neutron.services.segments.db.update_segment_host_mapping" :: waited 0.000s {{(pid=105517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:519}} Feb 16 18:13:19.989979 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:19.992424 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_inconsistencies' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:19.995847 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_for_igmp_snoop_support' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:19.996625 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.019033 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-834d63cb-3007-4b2a-a6e5-1b2a8050e46a None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:20.021372 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.026768 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_global_dhcp_opts' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.028271 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.042251 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} Feb 16 18:13:20.045395 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.046380 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.047021 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_localnet_port_has_learn_fdb' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.049341 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron_lib.callbacks.manager [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] Publish callbacks ['neutron.plugins.ml2.plugin.DhcpAgentSchedulerDbMixin.auto_schedule_new_network_segments-4014939', 'neutron.services.segments.plugin.NovaSegmentNotifier._notify_host_addition_to_aggregate-681330'] for segment_host_mapping (None), after_create {{(pid=105517) _notify_loop /opt/stack/data/venv/lib/python3.12/site-packages/neutron_lib/callbacks/manager.py:184}} Feb 16 18:13:20.064550 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.067579 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.cleanup_old_hash_ring_nodes' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.081417 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.092310 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.092976 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:20.098389 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:20.098803 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.100926 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.102057 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:20.104801 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.119229 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.134175 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_ovn_owned_dns_option' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.160938 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.165053 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in external_ids of LRPs. {{(pid=105517) update_lrouter_ports_ext_ids_name_prefix /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:501}} Feb 16 18:13:20.168198 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.services.segments.db [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] Segments {'2f29d294-726a-415d-8970-abc2512c6b46'} mapped to the host np0000155649 {{(pid=105517) update_segment_host_mapping /opt/stack/neutron/neutron/services/segments/db.py:249}} Feb 16 18:13:20.176255 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-811a21a1-99d0-40bf-9997-656426ad71c5 None None] Maintenance task: No inconsistencies found. Skipping {{(pid=105517) check_for_inconsistencies /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:384}} Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.179843 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:20.186949 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Maintenance task: Check missing prefix router_name in LRPs (took 0.00 seconds) Feb 16 18:13:20.195769 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_qos_fip_rule_priority' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.197055 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.344849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.345732 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:20.346693 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_lrouter_ports_ext_ids_name_prefix' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.347780 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:20.352880 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG oslo_concurrency.lockutils [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] Lock "update_segment_host_mapping" "released" by "neutron.services.segments.db.update_segment_host_mapping" :: held 0.206s {{(pid=105517) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:538}} Feb 16 18:13:20.368431 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.369717 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_qos_fip_rule_priority' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.370365 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.db.ovn_hash_ring_db [None req-a310aebe-0a02-4170-be6e-bd0768e4d5e0 None None] Cleaned up Hash Ring nodes older than 5 days Feb 16 18:13:20.375247 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-6f6c273c-2957-49d8-9b4c-beb8f68f7b39 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_baremetal_ports_dhcp_options' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.376742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.377741 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] OVN-SB Sync hostname and physical networks completed @ 2026-02-16 18:13:20.352867 {{(pid=105517) sync_hostname_and_physical_networks /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1492}} Feb 16 18:13:20.379700 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting immediate callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' {{(pid=105517) _process_immediates /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:673}} Feb 16 18:13:20.382170 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-e73f8087-d34c-4fae-8247-5dab4ab0b7c2 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_network_type_and_physnet' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.388735 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:20.405821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.406467 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:20.412859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:20.413428 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.413967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:20.413967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.413967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:20.424467 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'ignore_lsp_down': 'false', 'fdb_removal_limit': '0', 'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:20.424812 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.427831 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-50a3c476-9be0-489c-b76f-0e6e4889f9e5 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_distributed_flag' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.429975 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-17b4e7a2-9588-4d5e-8644-a186d7a96542 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_router_static_routes' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.430317 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:20.435065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.435843 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:20.441757 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.configure_nb_global' (it runs every 86400.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 915, in configure_nb_global Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self._nb_idl.set_nb_global_options(**options).execute( Feb 16 18:13:20.448388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.449125 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:20.449982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.449982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:20.452302 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:20.452441 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.453078 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.465695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.466589 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:20.536740 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-0f2c54cc-3d5c-4511-aba0-20564f331b10 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_network_broadcast_arps_to_all_routers' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.563947 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:20.588510 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-834d63cb-3007-4b2a-a6e5-1b2a8050e46a None None] Traceback (most recent call last): Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.593169 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-834d63cb-3007-4b2a-a6e5-1b2a8050e46a None None] Failed to call immediate 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.630677 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:20.631623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:20.657500 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-7040745b-0697-4b9b-b2a5-928dbaa68643 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_provider_distributed_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.724055 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [None req-10216262-9ef3-42fe-82f1-6c11ae16aa64 None None] Periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_redirect_type_router_gateway_ports' raised 'NeverAgain' exception, stopping any further execution of it. {{(pid=105517) _on_done /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:710}} Feb 16 18:13:20.862287 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] There are no commands to commit {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:78}} Feb 16 18:13:20.862814 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.ovn_db_sync [None req-65674928-5aa0-4889-af43-2dfe11719d0a None None] OVN-Southbound DB sync process completed @ 2026-02-16 18:13:20.862488 {{(pid=105517) do_sync /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_db_sync.py:1446}} Feb 16 18:13:21.400397 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(name=lrp-fceead43-58f4-4402-b8a4-a1ef42842e34, ipv6_prefix=[], mac=fa:16:3e:d3:b6:ab, gateway_chassis=[], external_ids={'neutron:is_ext_gw': 'False', 'neutron:network_name': 'neutron-9ffe4f07-7278-4e99-8342-27de602e7afe', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-7cf875b7-e6b2-4273-868c-92df52397632', 'neutron:subnet_ids': 'f52a1a5e-c480-4bd7-ac72-5a1ece411718'}, options={}, ha_chassis_group=[], status={}, enabled=[], networks=['fd::1/64'], peer=[], ipv6_ra_configs={'address_mode': 'slaac', 'mtu': '1372', 'send_periodic': 'true'}) old= {{(pid=105517) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Feb 16 18:13:21.402229 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.extensions.qos [-] Starting OVNClientQosExtension Feb 16 18:13:21.448559 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-9ffe4f07-7278-4e99-8342-27de602e7afe synchronized; highest priority chassis 03e61c11-f47e-402a-9a6f-a84914e35b91 Feb 16 18:13:21.449502 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-9ffe4f07-7278-4e99-8342-27de602e7afe, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '9ffe4f07-7278-4e99-8342-27de602e7afe', 'neutron:router_id': '7cf875b7-e6b2-4273-868c-92df52397632'}),), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:21.449918 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-9ffe4f07-7278-4e99-8342-27de602e7afe, chassis=03e61c11-f47e-402a-9a6f-a84914e35b91, priority=1, columns={}) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:21.450326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:21.451250 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event Traceback (most recent call last): Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event match.run(event, row, updates) Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 85, in run Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.l3_plugin._ovn_client.link_network_ha_chassis_group( Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2381, in link_network_ha_chassis_group Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event next(self.gen) Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with super().transaction(*args, **kwargs) as t: Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event next(self.gen) Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with self.create_transaction( Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.result = self.commit() Feb 16 18:13:21.453165 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event ^^^^^^^^^^^^^ Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event raise result.ex Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event txn.results.put(txn.do_commit()) Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^ Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event raise RuntimeError(msg) Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:21.454243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event Feb 16 18:13:23.349416 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched CREATE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(name=lrp-54236bfa-bd45-4179-af30-28f27fab5d7f, ipv6_prefix=[], mac=fa:16:3e:6c:71:d5, gateway_chassis=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-2ade759c-cdfc-4433-b0e8-d6bd48315f8d', 'neutron:revision_number': '8', 'neutron:router_name': 'neutron-7cf875b7-e6b2-4273-868c-92df52397632', 'neutron:subnet_ids': '4f52ace0-59d4-4fc4-b7d9-184a43cea9a8 dcac7125-e000-40b2-9117-c8b65fd6432a'}, options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, ha_chassis_group=[], status={}, enabled=[], networks=['172.24.5.195/24', '2001:db8::1/64'], peer=[], ipv6_ra_configs={}) old= {{(pid=105517) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Feb 16 18:13:23.350405 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.event [-] Matched DELETE: LogicalRouterPortEvent(events=('create', 'delete'), table='Logical_Router_Port', conditions=None, old_conditions=None), priority=20 to row=Logical_Router_Port(name=lrp-54236bfa-bd45-4179-af30-28f27fab5d7f, ipv6_prefix=[], mac=fa:16:3e:6c:71:d5, gateway_chassis=[], external_ids={'neutron:is_ext_gw': 'True', 'neutron:network_name': 'neutron-2ade759c-cdfc-4433-b0e8-d6bd48315f8d', 'neutron:revision_number': '1', 'neutron:router_name': 'neutron-7cf875b7-e6b2-4273-868c-92df52397632', 'neutron:subnet_ids': '4f52ace0-59d4-4fc4-b7d9-184a43cea9a8'}, options={'gateway_mtu': '1372', 'reside-on-redirect-chassis': 'true'}, ha_chassis_group=[], status={'hosting-chassis': '03e61c11-f47e-402a-9a6f-a84914e35b91'}, enabled=[], networks=['172.24.5.195/24'], peer=[], ipv6_ra_configs={}) old= {{(pid=105517) matches /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/event.py:55}} Feb 16 18:13:23.388267 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-9ffe4f07-7278-4e99-8342-27de602e7afe synchronized; highest priority chassis 03e61c11-f47e-402a-9a6f-a84914e35b91 Feb 16 18:13:23.389004 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-9ffe4f07-7278-4e99-8342-27de602e7afe, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '9ffe4f07-7278-4e99-8342-27de602e7afe', 'neutron:router_id': '7cf875b7-e6b2-4273-868c-92df52397632'}),), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:23.389540 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-9ffe4f07-7278-4e99-8342-27de602e7afe, chassis=03e61c11-f47e-402a-9a6f-a84914e35b91, priority=1, columns={}) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:23.389812 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.390620 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event Traceback (most recent call last): Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event match.run(event, row, updates) Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 88, in run Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.l3_plugin._ovn_client.update_router_ha_chassis_group( Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1635, in update_router_ha_chassis_group Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.link_network_ha_chassis_group(context, network_id, router_id) Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2381, in link_network_ha_chassis_group Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event next(self.gen) Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with super().transaction(*args, **kwargs) as t: Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event next(self.gen) Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:23.391922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with self.create_transaction( Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.result = self.commit() Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event ^^^^^^^^^^^^^ Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event raise result.ex Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event txn.results.put(txn.do_commit()) Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^ Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event raise RuntimeError(msg) Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.392439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event Feb 16 18:13:23.420507 np0000155649 neutron-ovn-maintenance-worker[105517]: INFO neutron.common.ovn.utils [-] HA Chassis Group neutron-9ffe4f07-7278-4e99-8342-27de602e7afe synchronized; highest priority chassis 03e61c11-f47e-402a-9a6f-a84914e35b91 Feb 16 18:13:23.421221 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=HA_Chassis_Group, record=neutron-9ffe4f07-7278-4e99-8342-27de602e7afe, col_values=(('external_ids', {'neutron:availability_zone_hints': '', 'neutron:network_id': '9ffe4f07-7278-4e99-8342-27de602e7afe', 'neutron:router_id': '7cf875b7-e6b2-4273-868c-92df52397632'}),), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:23.421638 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): HAChassisGroupAddChassisCommand(_result=None, hcg=neutron-9ffe4f07-7278-4e99-8342-27de602e7afe, chassis=03e61c11-f47e-402a-9a6f-a84914e35b91, priority=1, columns={}) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:23.421911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.422706 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event [-] Unexpected exception in notify_loop: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event Traceback (most recent call last): Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/event.py", line 185, in notify_loop Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event match.run(event, row, updates) Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/services/ovn_l3/ovsdb_monitor.py", line 80, in run Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.l3_plugin._ovn_client.update_router_ha_chassis_group( Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 1635, in update_router_ha_chassis_group Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.link_network_ha_chassis_group(context, network_id, router_id) Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/ovn_client.py", line 2381, in link_network_ha_chassis_group Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event next(self.gen) Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with super().transaction(*args, **kwargs) as t: Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event next(self.gen) Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:23.423577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event with self.create_transaction( Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event self.result = self.commit() Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event ^^^^^^^^^^^^^ Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event raise result.ex Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event txn.results.put(txn.do_commit()) Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event ^^^^^^^^^^^^^^^ Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event raise RuntimeError(msg) Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:23.425190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.event Feb 16 18:13:24.991423 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:24.993564 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b263792d-a78d-4180-9522-0bd2e948f6ac None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:25.032693 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:25.033226 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b263792d-a78d-4180-9522-0bd2e948f6ac None None] Traceback (most recent call last): Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.034253 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-b263792d-a78d-4180-9522-0bd2e948f6ac None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.035505 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.036264 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:25.068935 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:25.071063 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:25.071631 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.072881 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.075322 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.076064 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:25.102079 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:25.103244 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:25.103901 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:25.104166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.104869 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:25.106326 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.107032 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:25.107931 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:25.108644 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.109464 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:25.109464 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.109464 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:25.176336 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:25.177534 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:25.178172 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:25.178434 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:25.178619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.179841 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.181453 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:25.181981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:29.993515 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:29.996494 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b2471461-0504-4844-b9c3-68d4dc766255 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:30.033041 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:30.033247 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b2471461-0504-4844-b9c3-68d4dc766255 None None] Traceback (most recent call last): Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.034080 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-b2471461-0504-4844-b9c3-68d4dc766255 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.035891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.036512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:30.069983 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:30.073856 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:30.074074 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.074743 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.075635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.076223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:30.103204 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:30.104582 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:30.106114 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:30.106536 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.107373 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:30.108517 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.109078 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:30.109969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:30.110555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.111173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:30.111173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.111173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:30.177373 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:30.178340 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:30.179849 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:30.179849 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:30.179849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.180077 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.181911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:30.182503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:34.996186 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:35.000042 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-b2471461-0504-4844-b9c3-68d4dc766255 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:35.037969 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:35.038455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-b2471461-0504-4844-b9c3-68d4dc766255 None None] Traceback (most recent call last): Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.039762 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-b2471461-0504-4844-b9c3-68d4dc766255 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.040830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.041805 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:35.071219 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:35.072912 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:35.073378 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.076509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:35.077516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:35.078460 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.078460 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:35.078460 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.078460 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:35.104549 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:35.106123 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:35.106841 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:35.107257 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.108191 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:35.109687 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.110527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:35.111351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:35.112218 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.113065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:35.113065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.113065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:35.178416 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:35.179604 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:35.180158 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:35.180577 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:35.180774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.182739 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.183534 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:35.184382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:39.999344 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:40.001814 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6f522c29-c33d-406d-8eee-90043c16e323 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:40.034903 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:40.035464 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6f522c29-c33d-406d-8eee-90043c16e323 None None] Traceback (most recent call last): Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.036637 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-6f522c29-c33d-406d-8eee-90043c16e323 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.037791 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.038542 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:40.072649 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:40.075104 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:40.075529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.076545 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.078237 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.079093 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:40.105879 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:40.106986 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:40.107502 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:40.107748 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.108346 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:40.109681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.110463 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:40.111594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:40.112370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.113223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:40.113223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.113223 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:40.179768 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:40.181465 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:40.182245 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:40.182785 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:40.182990 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.183971 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.186112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:40.186695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:45.000685 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:45.004911 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-35ab7298-4622-4d52-b86c-f2aa3faac7a9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:45.031397 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:45.031877 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-35ab7298-4622-4d52-b86c-f2aa3faac7a9 None None] Traceback (most recent call last): Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.032801 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-35ab7298-4622-4d52-b86c-f2aa3faac7a9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.034012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.034346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:45.074412 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:45.075573 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:45.075833 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.076485 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.077370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.077864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:45.107044 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:45.108146 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:45.108648 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:45.108937 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.109658 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:45.110627 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.110958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:45.111983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:45.112325 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.112681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:45.112681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.112681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:45.181308 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:45.182256 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:45.182762 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:45.183174 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:45.183381 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.184121 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.185859 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:45.186666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:50.002504 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:50.004520 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-35ab7298-4622-4d52-b86c-f2aa3faac7a9 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:50.040081 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:50.040706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-35ab7298-4622-4d52-b86c-f2aa3faac7a9 None None] Traceback (most recent call last): Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.041539 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-35ab7298-4622-4d52-b86c-f2aa3faac7a9 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.042578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.043416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:50.075484 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:50.077124 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:50.077523 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.078402 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.080294 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.081067 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:50.108339 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:50.109384 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:50.109915 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:50.110238 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.110963 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:50.111984 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.112742 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:50.113117 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:50.113863 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.114714 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:50.114714 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.114714 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:50.182433 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:50.183467 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:50.184813 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:50.185301 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:50.185544 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.186586 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.188026 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:50.188911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:55.003416 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:55.005618 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95398ece-0345-403e-bac2-24ed54367bfd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:55.037295 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:55.037692 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95398ece-0345-403e-bac2-24ed54367bfd None None] Traceback (most recent call last): Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.038579 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-95398ece-0345-403e-bac2-24ed54367bfd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.039832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.040735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:55.076571 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:55.078027 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:55.078240 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.078756 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.080616 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.081450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:55.109334 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:55.110385 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:13:55.112628 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:55.112801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.113397 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:13:55.114811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.115753 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:13:55.116749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:55.117594 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.118551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:55.118551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.118551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:13:55.183714 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:13:55.184683 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:13:55.185611 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:55.185895 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:13:55.186024 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.186714 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.189259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:13:55.190037 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:00.004549 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:00.007128 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c5d0ffb8-485d-43e3-9560-b0fd59cb3442 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:00.041130 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:00.042625 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c5d0ffb8-485d-43e3-9560-b0fd59cb3442 None None] Traceback (most recent call last): Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.043040 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c5d0ffb8-485d-43e3-9560-b0fd59cb3442 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.044391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.045309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:00.077788 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:00.079514 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:00.080199 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.081179 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.083385 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.083964 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:00.110384 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:00.111456 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:00.112000 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:00.112447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.113217 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:00.114014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.114808 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:00.115203 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:00.115872 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.116632 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:00.116632 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.116632 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:00.184795 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:00.186092 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:00.186813 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:00.187394 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:00.187643 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.190556 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:00.191635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:00.192775 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:00.192775 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:00.192775 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:00.192775 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:05.005910 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:05.008400 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-50a290ab-6c59-4203-afdf-e7ea630d49ad None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:05.048717 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:05.048988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-50a290ab-6c59-4203-afdf-e7ea630d49ad None None] Traceback (most recent call last): Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.049748 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-50a290ab-6c59-4203-afdf-e7ea630d49ad None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.050955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.051801 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:05.078557 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:05.080142 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:05.080372 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.081565 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.083824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.084664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:05.111689 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:05.113867 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:05.114358 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:05.114570 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.115082 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:05.115967 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.116468 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:05.117222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:05.117771 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.118340 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:05.118340 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.118340 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:05.186196 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:05.187518 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:05.188118 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:05.189233 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:05.189610 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.190320 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.192085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:05.192630 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:10.007005 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:10.011169 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-9372318f-32c6-4795-9ff5-8d49179cbad1 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:10.012661 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG dbcounter [-] [105517] Writing DB stats neutron:SELECT=564,neutron:INSERT=1,neutron:UPDATE=2,neutron:DELETE=1 {{(pid=105517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Feb 16 18:14:10.054949 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:10.055378 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-9372318f-32c6-4795-9ff5-8d49179cbad1 None None] Traceback (most recent call last): Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.056281 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-9372318f-32c6-4795-9ff5-8d49179cbad1 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.057262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.058193 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:10.079658 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:10.081558 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:10.081869 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.082697 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.084599 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.085529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:10.114514 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:10.115311 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:10.115824 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:10.116207 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.116955 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:10.118263 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.119130 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:10.119934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:10.120698 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.121593 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:10.121593 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.121593 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:10.187498 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:10.189065 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:10.189775 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:10.190321 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:10.190548 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.191538 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.193269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:10.194248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:15.011000 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:15.013411 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5edef9d0-48bb-4f03-93aa-016d96900f76 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:15.047830 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:15.048527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5edef9d0-48bb-4f03-93aa-016d96900f76 None None] Traceback (most recent call last): Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.049833 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5edef9d0-48bb-4f03-93aa-016d96900f76 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.050892 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.051287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:15.081086 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:15.086170 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:15.086300 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.088451 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.089924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.090531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:15.115468 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:15.116530 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:15.117049 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:15.117349 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.117960 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:15.119160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.119908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:15.120691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:15.121581 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.122380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:15.122380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.122380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:15.189034 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:15.190046 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:15.190762 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:15.191382 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:15.191691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.192691 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.194373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:15.195412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:20.012082 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:20.014369 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f6261edd-83d9-4c9c-b56a-b92a11e1ec71 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:20.044532 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:20.044799 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f6261edd-83d9-4c9c-b56a-b92a11e1ec71 None None] Traceback (most recent call last): Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.045546 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-f6261edd-83d9-4c9c-b56a-b92a11e1ec71 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.046555 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.047466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:20.083291 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:20.084726 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:20.084911 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.085521 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.086734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.087319 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:20.116713 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:20.117851 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:20.118490 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:20.118793 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.119566 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:20.120416 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.121578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:20.122738 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.123981 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:20.189867 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:20.191318 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:20.191826 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:20.192080 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:20.192226 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.192847 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.194712 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:20.195267 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:25.013339 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-505ce1c1-912b-45b0-a24c-88d2c96ea115 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.340092 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.341684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.344524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.421857 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:25.422611 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.423706 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:25.424600 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:25.498399 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.499077 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.499437 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:25.499851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-505ce1c1-912b-45b0-a24c-88d2c96ea115 None None] Traceback (most recent call last): Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-505ce1c1-912b-45b0-a24c-88d2c96ea115 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:25.500200 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:25.500576 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:25.500977 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:25.500977 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:25.500977 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:25.500977 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:25.500977 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:25.500977 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:30.014494 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:30.017021 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-95398ece-0345-403e-bac2-24ed54367bfd None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:30.085491 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:30.087747 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:30.099765 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:30.100701 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:30.141715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:30.142279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.143246 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.144365 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.145380 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-95398ece-0345-403e-bac2-24ed54367bfd None None] Traceback (most recent call last): Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-95398ece-0345-403e-bac2-24ed54367bfd None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:30.165228 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:30.166090 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.166970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:30.192533 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:30.193996 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:30.194610 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:30.194998 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:30.195171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.195919 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.197679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:30.198619 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:35.015996 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:35.018832 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6f522c29-c33d-406d-8eee-90043c16e323 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:35.052631 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:35.052921 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6f522c29-c33d-406d-8eee-90043c16e323 None None] Traceback (most recent call last): Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.053388 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-6f522c29-c33d-406d-8eee-90043c16e323 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.055445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.056008 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:35.087252 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:35.089393 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:35.089763 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.092768 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:35.093962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:35.094864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.094864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:35.094864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.094864 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:35.123625 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:35.124859 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:35.125480 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:35.125807 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.126657 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:35.128308 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.128875 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:35.129969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:35.130613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.131226 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:35.131226 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.131226 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:35.194485 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:35.195424 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:35.196027 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:35.196410 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:35.196595 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.197583 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.200333 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:35.201434 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:40.017565 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:40.019774 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-d29091ac-920d-46f2-8f90-07faa9db4aad None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:40.054695 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:40.055176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-d29091ac-920d-46f2-8f90-07faa9db4aad None None] Traceback (most recent call last): Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.056160 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-d29091ac-920d-46f2-8f90-07faa9db4aad None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.057886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.059038 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:40.088821 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:40.090256 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:40.090552 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.091396 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.094164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:40.124793 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:40.125370 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:40.126233 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:40.126502 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.127119 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:40.128591 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.129508 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:40.130811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:40.131747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.132283 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:40.132283 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.132283 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:40.195475 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:40.196517 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:40.196977 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:40.197379 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:40.197525 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.198362 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.200884 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:40.201955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:45.018614 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:45.020272 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-f6261edd-83d9-4c9c-b56a-b92a11e1ec71 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:45.047203 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:45.047697 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-f6261edd-83d9-4c9c-b56a-b92a11e1ec71 None None] Traceback (most recent call last): Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.048670 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-f6261edd-83d9-4c9c-b56a-b92a11e1ec71 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.049635 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.050659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:45.089553 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:45.090443 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:45.090666 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.091274 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.093177 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.094063 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:45.125310 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:45.125856 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:45.126426 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:45.126709 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.127478 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:45.129382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.130490 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:45.131720 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.132955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:45.196383 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:45.197053 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:45.197577 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:45.197929 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:45.198104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.199024 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.200839 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:45.201997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:50.019350 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:50.022358 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:50.050556 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:50.051266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.052523 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.054374 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.055403 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:50.090126 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:50.091242 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:50.091625 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.092373 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.094215 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.094985 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:50.125751 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:50.126317 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:50.127072 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:50.127727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.128696 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:50.129997 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.131287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:50.132171 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:50.133005 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.133919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:50.133919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.133919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:50.197349 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:50.198132 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:50.199769 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:50.200280 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:50.200489 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.201830 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.203474 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:50.204341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:55.020105 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:55.021948 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-6e904eee-d60f-433c-8859-786b81dab549 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:55.089832 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:55.090275 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.091447 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e904eee-d60f-433c-8859-786b81dab549 None None] Traceback (most recent call last): Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.091867 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-6e904eee-d60f-433c-8859-786b81dab549 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.094347 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.095495 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.096714 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.098351 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.098908 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:55.126364 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:55.126975 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:14:55.127600 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:55.127912 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.128678 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:14:55.130011 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.130781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:14:55.131774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:55.132703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.133335 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:55.133335 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.133335 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:14:55.198383 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:14:55.199081 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:14:55.199814 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:55.200173 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:14:55.200446 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.201225 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.202879 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:14:55.203923 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:00.020733 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:00.021866 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:00.055052 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:00.055386 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.056222 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.057376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.058816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:00.093031 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:00.094897 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:00.095248 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-6e904eee-d60f-433c-8859-786b81dab549 None None] Traceback (most recent call last): Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.096731 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-6e904eee-d60f-433c-8859-786b81dab549 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:00.098427 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.099442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:00.126868 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:00.127317 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:00.127872 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:00.128231 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.128978 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:00.130188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.130724 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:00.131703 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:00.132352 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.132924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:00.132924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.132924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:00.199023 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:00.199651 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:00.200562 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:00.200975 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:00.201226 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.202379 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.204059 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:00.204922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:05.021412 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:05.023088 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:05.057359 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:05.057812 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.058822 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.060394 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.060891 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:05.094440 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:05.095327 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:05.095527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.096188 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:05.097645 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.098469 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:05.127483 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:05.127861 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:05.128276 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:05.128443 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.128874 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:05.129890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.130345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:05.130989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:05.131348 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.131764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:05.131764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.131764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:05.199625 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:05.200083 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:05.200703 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:05.201116 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:05.201401 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.202259 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.203623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:05.204243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:10.022241 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:10.024440 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:10.054084 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:10.054297 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.054767 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.055624 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.056123 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:10.094926 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:10.096054 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:10.096312 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.097036 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:10.098293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.099332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:10.128104 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:10.128510 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:10.129181 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:10.129506 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.131509 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:10.133266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.134408 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:10.136181 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:10.136782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.137679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:10.137679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.137679 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:10.200120 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:10.200938 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:10.201697 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:10.202153 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:10.202341 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.203230 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.205292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:10.205832 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:15.023223 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:15.025059 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:15.027011 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG dbcounter [-] [105517] Writing DB stats neutron:SELECT=260 {{(pid=105517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Feb 16 18:15:15.056576 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:15.057016 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.057900 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.058880 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.059829 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:15.095725 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:15.096751 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:15.097065 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.098189 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:15.099814 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.100606 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:15.128570 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:15.129094 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:15.129884 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:15.130154 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.130818 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:15.132277 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.132860 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:15.133934 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:15.134580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.135253 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:15.135253 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.135253 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:15.201113 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:15.201783 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:15.202373 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:15.202860 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:15.203050 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.204036 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.206095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:15.206821 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:20.024195 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:20.030776 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:20.062383 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:20.062807 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.063715 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.064634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.064983 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:20.105082 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.105501 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.106081 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.131705 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:20.132487 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.133214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:20.140529 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:20.140919 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.141418 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:20.141418 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.141418 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:20.201807 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:20.202545 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:20.203046 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:20.203450 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:20.203663 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.204466 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.206442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:20.207190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:25.029950 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:25.032004 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:25.071051 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:25.071524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.072382 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.073421 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.074262 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:25.096986 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:25.098044 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:25.098361 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.099112 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.100442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.101433 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:25.129603 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:25.130456 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:25.131544 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:25.131918 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.132876 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:25.134375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.135111 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:25.135899 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:25.136623 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.137431 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:25.137431 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.137431 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:25.202413 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:25.202961 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:25.203651 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:25.204095 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:25.204321 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.205044 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:25.206766 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:30.030842 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:30.032590 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:30.069082 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:30.069744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.071012 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.073054 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:30.097602 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:30.099342 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:30.100439 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.102292 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.103958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.104426 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:30.130543 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:30.131246 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:30.132176 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:30.132568 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.133525 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:30.134988 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.135694 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:30.136665 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:30.137345 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.138189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:30.138189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.138189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:30.203074 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:30.205271 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:30.205271 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:30.205271 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:30.205271 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.207031 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.208816 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:30.209957 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:35.031605 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:35.044573 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:35.084777 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:35.085110 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.086128 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.087102 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.088874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:35.098086 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:35.099040 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:35.099323 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.100075 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.102043 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.102916 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:35.131184 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:35.132012 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:35.132325 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:35.132567 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.133167 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:35.134447 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.136958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:35.137475 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.138001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:35.203897 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:35.204441 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:35.205370 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:35.205865 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:35.206107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.207221 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.208962 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:35.209739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:40.032181 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:40.033830 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:40.066982 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:40.067452 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.068315 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.069480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.070279 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:40.098593 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:40.099826 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:40.100151 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.101163 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.103159 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.103575 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:40.131735 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:40.132647 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:40.133366 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:40.133681 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.134562 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:40.135707 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.136420 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:40.136849 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:40.137532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.138503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:40.138503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.138503 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:40.204499 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:40.205182 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:40.205683 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:40.205953 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:40.206115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.206781 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.208608 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:40.210070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:45.032995 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:45.034645 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:45.071349 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:45.071823 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.073250 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.074449 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.075220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:45.099378 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:45.101368 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:45.102258 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.103332 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.106512 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.107375 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:45.132714 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:45.133552 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:45.134693 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:45.134840 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.135749 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:45.137166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.138015 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:45.138826 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:45.139688 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.140607 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:45.140607 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.140607 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:45.205134 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:45.205968 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:45.206652 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:45.207039 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:45.207251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.208096 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.210019 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:45.210922 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:50.033908 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:50.035839 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:50.071110 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:50.071622 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.072641 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.073695 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.074404 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:50.100491 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:50.101436 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:50.101750 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.102520 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.103873 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.104851 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:50.133489 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:50.134044 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:50.134798 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:50.135252 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.136112 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:50.137457 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.138164 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:50.139003 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:50.139734 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.140559 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:50.140559 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.140559 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:50.205850 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:50.206800 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:50.207641 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:50.208157 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:50.208455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.211558 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:50.212309 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:55.035123 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:55.038401 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:55.140612 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:55.141845 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:55.143123 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:15:55.143870 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:55.144058 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.144739 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:55.145325 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:55.146085 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.147239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:15:55.148551 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.149800 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:15:55.150959 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:55.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:55.153103 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.153704 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.154545 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:15:55.206518 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:15:55.206867 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:15:55.207381 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:55.207765 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:15:55.208014 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.208885 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.210774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:15:55.211662 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:00.035935 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:00.037584 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:00.068725 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:00.069233 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.070269 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.071486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.072293 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:00.142917 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:00.143321 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:00.145202 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:00.146181 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:00.146540 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.147491 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:00.147773 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Traceback (most recent call last): Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.148531 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.148941 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:00.150205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.150992 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:00.152660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.153450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5ff0b892-514a-430a-a14a-c72df7bb5b48 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:00.154356 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:00.155166 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.156070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:00.156070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.156070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:00.207347 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:00.208217 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:00.208759 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:00.209121 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:00.209350 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.210190 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.212091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:00.213107 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:05.036629 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:05.038323 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:05.074798 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:05.075209 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.076031 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.076955 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.077779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:05.143759 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:05.144690 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:05.144876 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.145613 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.146909 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.147674 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:05.148513 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:05.148513 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:05.148969 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:05.149148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.149811 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:05.151598 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.152346 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:05.153170 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:05.153824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.154376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:05.154376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.154376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:05.207788 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:05.208167 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:05.208603 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:05.208846 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:05.208936 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.209520 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.211070 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:05.211868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:10.037370 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:10.038308 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:10.072493 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:10.072970 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.074272 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.075727 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.076620 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:10.144673 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:10.145829 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:10.146370 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.147266 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.149718 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.150854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:10.151885 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:10.151885 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:10.151885 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:10.151885 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.152779 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:10.154088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.154824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:10.155445 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:10.156243 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.157089 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:10.157089 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.157089 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:10.208415 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:10.208915 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:10.209742 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:10.210252 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:10.210461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.211354 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.213115 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:10.214104 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:15.038069 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:15.041598 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:15.043424 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG dbcounter [-] [105517] Writing DB stats neutron:SELECT=240 {{(pid=105517) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Feb 16 18:16:15.084018 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:15.084440 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.085669 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.087179 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.088126 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:15.145472 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:15.146978 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:15.147522 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.148660 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.150774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.151577 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:15.152343 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:15.152343 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:15.152343 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:15.152524 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.153180 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:15.155944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.156845 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:15.157287 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:15.157999 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.158837 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:15.158837 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.158837 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:15.209027 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.473949 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.474407 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:15.474890 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:20.038975 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:20.041191 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:20.077810 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:20.078291 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.079314 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.081205 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.082220 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:20.146311 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:20.147192 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:20.147418 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.148034 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:20.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.150654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:20.151702 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:20.152015 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:20.152265 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:20.152412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Traceback (most recent call last): Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.152760 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:20.153336 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-c137cca7-665b-4446-8c46-c877b007e098 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:20.154057 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.154868 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.156331 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:20.209467 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:20.210314 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:20.211025 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:20.211540 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:20.211739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.212660 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.214023 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:20.215079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:25.039890 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:25.041594 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:25.074925 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:25.075647 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.076654 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.077633 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.078532 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:25.147089 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:25.148678 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:25.149035 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.150275 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:25.152391 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.153229 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:25.154307 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:25.154307 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:25.154307 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:25.154307 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.154811 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:25.155824 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.156669 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:25.157176 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:25.157989 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.158944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:25.158944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.158944 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:25.209975 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:25.210369 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:25.210797 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:25.211069 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:25.211189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.211831 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.213696 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:25.215472 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:30.040533 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:30.044283 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:30.073684 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:30.073896 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:30.075731 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:30.076301 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.076794 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:30.076794 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:30.076794 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.076794 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:30.076794 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.076794 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:30.147625 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:30.148705 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:30.149001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.149990 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:30.151850 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.152605 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:30.153418 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:30.153587 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:30.154082 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:30.154377 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.155086 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:30.156747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.157480 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:30.158486 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:30.158953 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.159454 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:30.159454 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.159454 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:30.210447 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:30.210981 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:30.211597 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:30.211968 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:30.212129 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.212921 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.214735 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:30.215743 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:35.041894 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:35.043735 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:35.075492 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:35.075874 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.076702 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.077749 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.078626 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:35.148326 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:35.149508 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:35.149770 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.150708 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:35.152667 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.153425 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:35.154306 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:35.154306 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:35.154627 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:35.154921 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.155647 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:35.156958 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.157657 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:35.158488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:35.158982 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.159510 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:35.159510 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.159510 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:35.210944 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:35.211826 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:35.212171 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:35.212546 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:35.212730 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.213790 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.216764 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:35.217987 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:40.042591 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:40.044032 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:40.076177 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:40.076569 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.077417 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.078470 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.079289 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:40.148751 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:40.149788 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:40.149788 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.150456 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:40.151664 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.152120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:40.153979 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:40.154405 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:40.154821 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:40.155091 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.155897 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:40.157155 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.157586 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:40.159088 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:40.159516 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.160001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:40.160001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.160001 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:40.211526 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:40.211835 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:40.212319 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:40.212684 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:40.212862 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.213634 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.215157 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:40.215924 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:45.043438 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:45.045361 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.090189 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.090739 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.091120 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:45.149570 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:45.150648 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:45.151083 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.152196 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:45.154541 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.154993 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:45.155927 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:45.156355 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:45.157223 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:45.157683 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.158442 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:45.159298 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.159782 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:45.160715 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:45.161527 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.162048 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:45.162048 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.162048 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:45.212178 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:45.213786 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:45.214350 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:45.214719 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:45.214914 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.217376 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.218660 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:45.219424 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:50.043912 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:50.045797 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:50.080629 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:50.081079 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.082410 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.083580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.083886 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:50.150102 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:50.151443 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:50.151854 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.152937 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:50.154858 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.155214 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:50.156290 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:50.156738 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:50.157270 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:50.157578 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.158296 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:50.159550 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.159897 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:50.161116 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:50.161455 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.161833 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:50.161833 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.161833 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:50.213838 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:50.214329 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:50.215069 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:50.215568 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:50.215774 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.216708 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.218459 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:50.219173 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:55.044709 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:55.046479 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:55.083725 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:55.084236 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.085384 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.086744 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.087684 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:55.150844 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:55.152109 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:55.152450 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.153497 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:55.155239 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.156288 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:55.157746 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:55.157746 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:16:55.157746 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:55.157746 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.158580 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:16:55.159659 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.160430 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:16:55.161148 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:55.161747 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.162488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:55.162488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.162488 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:16:55.214404 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:16:55.214851 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:16:55.215616 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:55.216014 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:16:55.216247 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.217253 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.218969 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:16:55.220095 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:17:00.045274 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:17:00.047006 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Setting NB_Global options: {'fdb_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:17:00.079266 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'fdb_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:17:00.079523 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Traceback (most recent call last): Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.080210 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-268d353e-8af3-40c1-a2db-2550b12d6cf6 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_fdb_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 777, in check_fdb_aging_settings Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.081366 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.082251 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:17:00.151474 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:17:00.152891 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelStaticRoutesCommand(_result=None, lrouter=neutron-7cf875b7-e6b2-4273-868c-92df52397632, routes=[], if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:17:00.153339 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Traceback (most recent call last): Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.154604 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [None req-5d690d10-7782-41f2-b436-4e2b01a773d2 None None] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.check_router_default_route_empty_dst_ip' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 869, in check_router_default_route_empty_dst_ip Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:17:00.156590 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.157320 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:17:00.158058 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:17:00.158058 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance [-] Setting fip-distributed flag in NB_Global to False {{(pid=105517) set_fip_distributed_flag /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py:1068}} Feb 16 18:17:00.158223 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('external_ids', {'neutron:fip-distributed': 'False'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:17:00.158693 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.159451 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command [-] Error executing command (DbSetCommand): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Traceback (most recent call last): Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with super().transaction(*args, **kwargs) as t: Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command next(self.gen) Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command with self.create_transaction( Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command self.result = self.commit() Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^ Feb 16 18:17:00.160705 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise result.ex Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command txn.results.put(txn.do_commit()) Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command ^^^^^^^^^^^^^^^ Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command raise RuntimeError(msg) Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.161461 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.command Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.set_fip_distributed_flag' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 1072, in set_fip_distributed_flag Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ovn_const.OVN_FIP_DISTRIBUTED_KEY: str(distributed)}).execute( Feb 16 18:17:00.162412 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^ Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/command.py", line 49, in execute Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.api.transaction(check_error, log_errors, **kwargs) as t: Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:17:00.163118 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.163632 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:17:00.163632 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.163632 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Feb 16 18:17:00.215215 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG futurist.periodics [-] Submitting periodic callback 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' {{(pid=105517) _process_scheduled /opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py:638}} Feb 16 18:17:00.215830 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.impl_idl_ovn [-] Setting NB_Global options: {'mac_binding_removal_limit': '0'} {{(pid=105517) set_nb_global_options /opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py:942}} Feb 16 18:17:00.216635 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbSetCommand(_result=None, table=NB_Global, record=., col_values=dict_items([('options', {'mac_binding_removal_limit': '0'})]), if_exists=True) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:17:00.217030 np0000155649 neutron-ovn-maintenance-worker[105517]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): SetLRouterMacAgeLimitCommand(_result=None, router=None, threshold=0) {{(pid=105517) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Feb 16 18:17:00.217274 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR ovsdbapp.backend.ovs_idl.transaction [-] Traceback (most recent call last): Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: txn.results.put(txn.do_commit()) Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: ^^^^^^^^^^^^^^^ Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: raise RuntimeError(msg) Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.218167 np0000155649 neutron-ovn-maintenance-worker[105517]: Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics [-] Failed to call periodic 'neutron.plugins.ml2.drivers.ovn.mech_driver.ovsdb.maintenance.DBInconsistenciesPeriodics.update_mac_aging_settings' (it runs every 5.00 seconds): RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics Traceback (most recent call last): Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 290, in run Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics work() Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 64, in __call__ Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return self.callback(*self.args, **self.kwargs) Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/futurist/periodics.py", line 178, in decorator Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(*args, **kwargs) Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 82, in decorator Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics return f(self, *args, **kwargs) Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^^^^^^^^^^ Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/maintenance.py", line 791, in update_mac_aging_settings Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self._nb_idl.transaction(check_error=True) as txn: Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.220060 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/neutron/neutron/plugins/ml2/drivers/ovn/mech_driver/ovsdb/impl_idl_ovn.py", line 271, in transaction Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with super().transaction(*args, **kwargs) as t: Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/usr/lib/python3.12/contextlib.py", line 144, in __exit__ Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics next(self.gen) Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 114, in transaction Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics with self.create_transaction( Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/api.py", line 71, in __exit__ Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics self.result = self.commit() Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^ Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 64, in commit Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise result.ex Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/connection.py", line 127, in run Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics txn.results.put(txn.do_commit()) Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics ^^^^^^^^^^^^^^^ Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics File "/opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py", line 123, in do_commit Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics raise RuntimeError(msg) Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics RuntimeError: OVSDB Error: The transaction failed because the IDL has been configured to require a database lock but didn't get it yet or has already lost it Feb 16 18:17:00.221792 np0000155649 neutron-ovn-maintenance-worker[105517]: ERROR futurist.periodics